2023-02-08 07:02:39,616 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-08 07:02:39,660 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=166, AvailableMemoryMB=5740 2023-02-08 07:02:39,948 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8 2023-02-08 07:02:39,956 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 07:02:39,956 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/cluster_340e2e30-d8f7-817e-1e6c-e3d23c94ed6c, deleteOnExit=true 2023-02-08 07:02:39,956 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 07:02:39,957 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/test.cache.data in system properties and HBase conf 2023-02-08 07:02:39,957 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 07:02:39,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/hadoop.log.dir in system properties and HBase conf 2023-02-08 07:02:39,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 07:02:39,959 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 07:02:39,959 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 07:02:40,053 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-08 07:02:40,429 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 07:02:40,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:02:40,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:02:40,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 07:02:40,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:02:40,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 07:02:40,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 07:02:40,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:02:40,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:02:40,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 07:02:40,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/nfs.dump.dir in system properties and HBase conf 2023-02-08 07:02:40,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/java.io.tmpdir in system properties and HBase conf 2023-02-08 07:02:40,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:02:40,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 07:02:40,441 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 07:02:40,937 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:02:40,941 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:02:41,198 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-08 07:02:41,356 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-08 07:02:41,370 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:02:41,408 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:02:41,446 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/java.io.tmpdir/Jetty_localhost_46329_hdfs____.n721cu/webapp 2023-02-08 07:02:41,603 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46329 2023-02-08 07:02:41,615 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:02:41,616 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:02:42,113 WARN [Listener at localhost/44277] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:02:42,188 WARN [Listener at localhost/44277] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:02:42,214 WARN [Listener at localhost/44277] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:02:42,223 INFO [Listener at localhost/44277] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:02:42,229 INFO [Listener at localhost/44277] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/java.io.tmpdir/Jetty_localhost_37269_datanode____tqsdtk/webapp 2023-02-08 07:02:42,345 INFO [Listener at localhost/44277] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37269 2023-02-08 07:02:42,764 WARN [Listener at localhost/45181] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:02:42,829 WARN [Listener at localhost/45181] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:02:42,836 WARN [Listener at localhost/45181] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:02:42,838 INFO [Listener at localhost/45181] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:02:42,844 INFO [Listener at localhost/45181] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/java.io.tmpdir/Jetty_localhost_37721_datanode____dkp7sp/webapp 2023-02-08 07:02:42,992 INFO [Listener at localhost/45181] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37721 2023-02-08 07:02:43,007 WARN [Listener at localhost/32917] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:02:43,302 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd518f96826f6d491: Processing first storage report for DS-ec473ffb-c04c-433a-bfc3-efb6105100d5 from datanode efe56570-012e-4404-8f27-996c7cf42783 2023-02-08 07:02:43,304 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd518f96826f6d491: from storage DS-ec473ffb-c04c-433a-bfc3-efb6105100d5 node DatanodeRegistration(127.0.0.1:46033, datanodeUuid=efe56570-012e-4404-8f27-996c7cf42783, infoPort=37925, infoSecurePort=0, ipcPort=45181, storageInfo=lv=-57;cid=testClusterID;nsid=1010749956;c=1675839761008), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-08 07:02:43,305 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5c0912d69460e5bb: Processing first storage report for DS-36424b27-d441-4e98-b345-b9c51daea85e from datanode 22a52fe2-643c-41fa-9df8-0ffb117ab2d6 2023-02-08 07:02:43,305 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5c0912d69460e5bb: from storage DS-36424b27-d441-4e98-b345-b9c51daea85e node DatanodeRegistration(127.0.0.1:36837, datanodeUuid=22a52fe2-643c-41fa-9df8-0ffb117ab2d6, infoPort=46481, infoSecurePort=0, ipcPort=32917, storageInfo=lv=-57;cid=testClusterID;nsid=1010749956;c=1675839761008), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:02:43,305 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd518f96826f6d491: Processing first storage report for DS-fe25e64b-fe8a-4b52-8185-58930a0ebc55 from datanode efe56570-012e-4404-8f27-996c7cf42783 2023-02-08 07:02:43,305 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd518f96826f6d491: from storage DS-fe25e64b-fe8a-4b52-8185-58930a0ebc55 node DatanodeRegistration(127.0.0.1:46033, datanodeUuid=efe56570-012e-4404-8f27-996c7cf42783, infoPort=37925, infoSecurePort=0, ipcPort=45181, storageInfo=lv=-57;cid=testClusterID;nsid=1010749956;c=1675839761008), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:02:43,305 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5c0912d69460e5bb: Processing first storage report for DS-e140f215-5df9-4382-9430-4e6a2f1fdee1 from datanode 22a52fe2-643c-41fa-9df8-0ffb117ab2d6 2023-02-08 07:02:43,305 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5c0912d69460e5bb: from storage DS-e140f215-5df9-4382-9430-4e6a2f1fdee1 node DatanodeRegistration(127.0.0.1:36837, datanodeUuid=22a52fe2-643c-41fa-9df8-0ffb117ab2d6, infoPort=46481, infoSecurePort=0, ipcPort=32917, storageInfo=lv=-57;cid=testClusterID;nsid=1010749956;c=1675839761008), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:02:43,433 DEBUG [Listener at localhost/32917] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8 2023-02-08 07:02:43,517 INFO [Listener at localhost/32917] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/cluster_340e2e30-d8f7-817e-1e6c-e3d23c94ed6c/zookeeper_0, clientPort=54762, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/cluster_340e2e30-d8f7-817e-1e6c-e3d23c94ed6c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/cluster_340e2e30-d8f7-817e-1e6c-e3d23c94ed6c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 07:02:43,536 INFO [Listener at localhost/32917] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54762 2023-02-08 07:02:43,545 INFO [Listener at localhost/32917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:02:43,548 INFO [Listener at localhost/32917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:02:44,220 INFO [Listener at localhost/32917] util.FSUtils(479): Created version file at hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99 with version=8 2023-02-08 07:02:44,221 INFO [Listener at localhost/32917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:02:44,223 INFO [Listener at localhost/32917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:02:44,227 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/hbase-staging 2023-02-08 07:02:44,550 INFO [Listener at localhost/32917] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-08 07:02:45,008 INFO [Listener at localhost/32917] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:02:45,041 INFO [Listener at localhost/32917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:02:45,042 INFO [Listener at localhost/32917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:02:45,042 INFO [Listener at localhost/32917] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:02:45,042 INFO [Listener at localhost/32917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:02:45,042 INFO [Listener at localhost/32917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:02:45,197 INFO [Listener at localhost/32917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:02:45,270 DEBUG [Listener at localhost/32917] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-08 07:02:45,365 INFO [Listener at localhost/32917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40701 2023-02-08 07:02:45,375 INFO [Listener at localhost/32917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:02:45,377 INFO [Listener at localhost/32917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:02:45,403 INFO [Listener at localhost/32917] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40701 connecting to ZooKeeper ensemble=127.0.0.1:54762 2023-02-08 07:02:45,450 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:407010x0, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:02:45,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40701-0x10032bd5def0000 connected 2023-02-08 07:02:45,480 DEBUG [Listener at localhost/32917] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:02:45,481 DEBUG [Listener at localhost/32917] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:02:45,485 DEBUG [Listener at localhost/32917] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:02:45,493 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40701 2023-02-08 07:02:45,493 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40701 2023-02-08 07:02:45,494 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40701 2023-02-08 07:02:45,495 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40701 2023-02-08 07:02:45,496 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40701 2023-02-08 07:02:45,502 INFO [Listener at localhost/32917] master.HMaster(439): hbase.rootdir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99, hbase.cluster.distributed=false 2023-02-08 07:02:45,568 INFO [Listener at localhost/32917] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:02:45,568 INFO [Listener at localhost/32917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:02:45,568 INFO [Listener at localhost/32917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:02:45,568 INFO [Listener at localhost/32917] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:02:45,568 INFO [Listener at localhost/32917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:02:45,569 INFO [Listener at localhost/32917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:02:45,574 INFO [Listener at localhost/32917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:02:45,577 INFO [Listener at localhost/32917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41961 2023-02-08 07:02:45,579 INFO [Listener at localhost/32917] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:02:45,587 DEBUG [Listener at localhost/32917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:02:45,588 INFO [Listener at localhost/32917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:02:45,591 INFO [Listener at localhost/32917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:02:45,593 INFO [Listener at localhost/32917] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41961 connecting to ZooKeeper ensemble=127.0.0.1:54762 2023-02-08 07:02:45,597 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:419610x0, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:02:45,598 DEBUG [Listener at localhost/32917] zookeeper.ZKUtil(164): regionserver:419610x0, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:02:45,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41961-0x10032bd5def0001 connected 2023-02-08 07:02:45,599 DEBUG [Listener at localhost/32917] zookeeper.ZKUtil(164): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:02:45,600 DEBUG [Listener at localhost/32917] zookeeper.ZKUtil(164): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:02:45,601 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41961 2023-02-08 07:02:45,602 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41961 2023-02-08 07:02:45,602 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41961 2023-02-08 07:02:45,603 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41961 2023-02-08 07:02:45,603 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41961 2023-02-08 07:02:45,615 INFO [Listener at localhost/32917] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:02:45,615 INFO [Listener at localhost/32917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:02:45,615 INFO [Listener at localhost/32917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:02:45,616 INFO [Listener at localhost/32917] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:02:45,616 INFO [Listener at localhost/32917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:02:45,616 INFO [Listener at localhost/32917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:02:45,616 INFO [Listener at localhost/32917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:02:45,618 INFO [Listener at localhost/32917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35063 2023-02-08 07:02:45,618 INFO [Listener at localhost/32917] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:02:45,620 DEBUG [Listener at localhost/32917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:02:45,620 INFO [Listener at localhost/32917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:02:45,622 INFO [Listener at localhost/32917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:02:45,625 INFO [Listener at localhost/32917] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35063 connecting to ZooKeeper ensemble=127.0.0.1:54762 2023-02-08 07:02:45,631 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:350630x0, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:02:45,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35063-0x10032bd5def0002 connected 2023-02-08 07:02:45,632 DEBUG [Listener at localhost/32917] zookeeper.ZKUtil(164): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:02:45,633 DEBUG [Listener at localhost/32917] zookeeper.ZKUtil(164): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:02:45,634 DEBUG [Listener at localhost/32917] zookeeper.ZKUtil(164): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:02:45,634 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35063 2023-02-08 07:02:45,636 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35063 2023-02-08 07:02:45,640 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35063 2023-02-08 07:02:45,640 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35063 2023-02-08 07:02:45,641 DEBUG [Listener at localhost/32917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35063 2023-02-08 07:02:45,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40701,1675839764394 2023-02-08 07:02:45,651 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:02:45,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40701,1675839764394 2023-02-08 07:02:45,673 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:02:45,673 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:02:45,673 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:02:45,673 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:02:45,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:02:45,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40701,1675839764394 from backup master directory 2023-02-08 07:02:45,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:02:45,680 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40701,1675839764394 2023-02-08 07:02:45,680 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:02:45,681 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:02:45,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,40701,1675839764394 2023-02-08 07:02:45,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-08 07:02:45,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-08 07:02:45,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/hbase.id with ID: 7bd6778c-2cfd-4a27-a2d4-c6a78d73b6c3 2023-02-08 07:02:45,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:02:45,824 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:02:45,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2faec1ea to 127.0.0.1:54762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:02:45,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34b66fe7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:02:45,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:02:45,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 07:02:45,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-08 07:02:45,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-08 07:02:45,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-08 07:02:45,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-08 07:02:45,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:02:46,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/data/master/store-tmp 2023-02-08 07:02:46,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:46,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:02:46,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:02:46,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:02:46,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:02:46,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:02:46,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:02:46,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839766036Disabling compacts and flushes for region at 1675839766037 (+1 ms)Disabling writes for close at 1675839766037Writing region close event to WAL at 1675839766037Closed at 1675839766037 2023-02-08 07:02:46,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/WALs/jenkins-hbase4.apache.org,40701,1675839764394 2023-02-08 07:02:46,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40701%2C1675839764394, suffix=, logDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/WALs/jenkins-hbase4.apache.org,40701,1675839764394, archiveDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/oldWALs, maxLogs=10 2023-02-08 07:02:46,117 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36837,DS-36424b27-d441-4e98-b345-b9c51daea85e,DISK] 2023-02-08 07:02:46,117 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46033,DS-ec473ffb-c04c-433a-bfc3-efb6105100d5,DISK] 2023-02-08 07:02:46,125 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-08 07:02:46,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/WALs/jenkins-hbase4.apache.org,40701,1675839764394/jenkins-hbase4.apache.org%2C40701%2C1675839764394.1675839766072 2023-02-08 07:02:46,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36837,DS-36424b27-d441-4e98-b345-b9c51daea85e,DISK], DatanodeInfoWithStorage[127.0.0.1:46033,DS-ec473ffb-c04c-433a-bfc3-efb6105100d5,DISK]] 2023-02-08 07:02:46,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:02:46,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:46,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:02:46,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:02:46,255 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:02:46,263 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 07:02:46,292 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 07:02:46,304 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:46,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:02:46,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:02:46,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:02:46,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:46,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72650442, jitterRate=0.08257594704627991}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:02:46,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675839766223Initializing all the Stores at 1675839766226 (+3 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839766226Cleaning up temporary data from old regions at 1675839766318 (+92 ms)Cleaning up detritus from prior splits at 1675839766318Region opened successfully at 1675839766331 (+13 ms) 2023-02-08 07:02:46,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 07:02:46,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 07:02:46,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 07:02:46,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 07:02:46,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-08 07:02:46,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-02-08 07:02:46,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 07:02:46,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 07:02:46,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 07:02:46,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 07:02:46,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 07:02:46,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 07:02:46,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 07:02:46,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 07:02:46,481 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:02:46,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 07:02:46,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 07:02:46,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 07:02:46,500 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:02:46,500 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:02:46,501 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:02:46,500 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:02:46,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,40701,1675839764394, sessionid=0x10032bd5def0000, setting cluster-up flag (Was=false) 2023-02-08 07:02:46,522 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:02:46,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 07:02:46,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40701,1675839764394 2023-02-08 07:02:46,536 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:02:46,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 07:02:46,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40701,1675839764394 2023-02-08 07:02:46,547 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.hbase-snapshot/.tmp 2023-02-08 07:02:46,645 INFO [RS:0;jenkins-hbase4:41961] regionserver.HRegionServer(952): ClusterId : 7bd6778c-2cfd-4a27-a2d4-c6a78d73b6c3 2023-02-08 07:02:46,645 INFO [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(952): ClusterId : 7bd6778c-2cfd-4a27-a2d4-c6a78d73b6c3 2023-02-08 07:02:46,650 DEBUG [RS:0;jenkins-hbase4:41961] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:02:46,650 DEBUG [RS:1;jenkins-hbase4:35063] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:02:46,658 DEBUG [RS:0;jenkins-hbase4:41961] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:02:46,658 DEBUG [RS:1;jenkins-hbase4:35063] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:02:46,658 DEBUG [RS:0;jenkins-hbase4:41961] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:02:46,658 DEBUG [RS:1;jenkins-hbase4:35063] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:02:46,662 DEBUG [RS:1;jenkins-hbase4:35063] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:02:46,662 DEBUG [RS:0;jenkins-hbase4:41961] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:02:46,664 DEBUG [RS:1;jenkins-hbase4:35063] zookeeper.ReadOnlyZKClient(139): Connect 0x751e1a2a to 127.0.0.1:54762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:02:46,664 DEBUG [RS:0;jenkins-hbase4:41961] zookeeper.ReadOnlyZKClient(139): Connect 0x6925ba30 to 127.0.0.1:54762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:02:46,679 DEBUG [RS:1;jenkins-hbase4:35063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50960c1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:02:46,680 DEBUG [RS:1;jenkins-hbase4:35063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d5fe713, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:02:46,680 DEBUG [RS:0;jenkins-hbase4:41961] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ded7892, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:02:46,680 DEBUG [RS:0;jenkins-hbase4:41961] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@495f553, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:02:46,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 07:02:46,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:02:46,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:02:46,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:02:46,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:02:46,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 07:02:46,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:02:46,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675839796698 2023-02-08 07:02:46,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 07:02:46,704 DEBUG [RS:1;jenkins-hbase4:35063] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35063 2023-02-08 07:02:46,706 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:02:46,706 DEBUG [RS:0;jenkins-hbase4:41961] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41961 2023-02-08 07:02:46,707 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 07:02:46,710 INFO [RS:1;jenkins-hbase4:35063] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:02:46,710 INFO [RS:0;jenkins-hbase4:41961] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:02:46,710 INFO [RS:1;jenkins-hbase4:35063] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:02:46,710 INFO [RS:0;jenkins-hbase4:41961] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:02:46,710 DEBUG [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:02:46,711 DEBUG [RS:0;jenkins-hbase4:41961] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:02:46,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 07:02:46,712 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:02:46,714 INFO [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40701,1675839764394 with isa=jenkins-hbase4.apache.org/172.31.14.131:35063, startcode=1675839765615 2023-02-08 07:02:46,714 INFO [RS:0;jenkins-hbase4:41961] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40701,1675839764394 with isa=jenkins-hbase4.apache.org/172.31.14.131:41961, startcode=1675839765567 2023-02-08 07:02:46,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 07:02:46,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 07:02:46,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 07:02:46,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 07:02:46,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 07:02:46,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 07:02:46,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 07:02:46,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 07:02:46,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 07:02:46,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839766730,5,FailOnTimeoutGroup] 2023-02-08 07:02:46,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839766731,5,FailOnTimeoutGroup] 2023-02-08 07:02:46,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 07:02:46,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,742 DEBUG [RS:1;jenkins-hbase4:35063] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:02:46,742 DEBUG [RS:0;jenkins-hbase4:41961] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:02:46,750 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:02:46,751 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:02:46,752 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99 2023-02-08 07:02:46,785 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:46,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:02:46,793 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/info 2023-02-08 07:02:46,794 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:02:46,795 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:46,796 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:02:46,798 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:02:46,798 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:02:46,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:46,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:02:46,801 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/table 2023-02-08 07:02:46,802 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:02:46,803 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:46,805 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740 2023-02-08 07:02:46,806 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740 2023-02-08 07:02:46,813 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:02:46,815 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:02:46,819 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57247, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:02:46,819 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33603, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:02:46,820 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:46,823 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63440506, jitterRate=-0.0546627938747406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:02:46,823 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675839766786Initializing all the Stores at 1675839766789 (+3 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839766790 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839766790Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839766790Cleaning up temporary data from old regions at 1675839766809 (+19 ms)Cleaning up detritus from prior splits at 1675839766810 (+1 ms)Region opened successfully at 1675839766823 (+13 ms) 2023-02-08 07:02:46,823 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:02:46,823 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:02:46,823 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:02:46,823 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:02:46,823 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:02:46,824 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:02:46,825 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839766823Disabling compacts and flushes for region at 1675839766823Disabling writes for close at 1675839766823Writing region close event to WAL at 1675839766824 (+1 ms)Closed at 1675839766824 2023-02-08 07:02:46,831 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:02:46,831 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 07:02:46,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40701] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:46,835 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:46,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 07:02:46,856 DEBUG [RS:0;jenkins-hbase4:41961] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99 2023-02-08 07:02:46,856 DEBUG [RS:0;jenkins-hbase4:41961] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44277 2023-02-08 07:02:46,856 DEBUG [RS:0;jenkins-hbase4:41961] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:02:46,856 DEBUG [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99 2023-02-08 07:02:46,857 DEBUG [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44277 2023-02-08 07:02:46,857 DEBUG [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:02:46,858 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 07:02:46,864 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:02:46,864 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 07:02:46,869 DEBUG [RS:0;jenkins-hbase4:41961] zookeeper.ZKUtil(162): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:46,869 WARN [RS:0;jenkins-hbase4:41961] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:02:46,869 INFO [RS:0;jenkins-hbase4:41961] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:02:46,869 DEBUG [RS:0;jenkins-hbase4:41961] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/WALs/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:46,869 DEBUG [RS:1;jenkins-hbase4:35063] zookeeper.ZKUtil(162): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:46,869 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35063,1675839765615] 2023-02-08 07:02:46,870 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41961,1675839765567] 2023-02-08 07:02:46,869 WARN [RS:1;jenkins-hbase4:35063] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:02:46,870 INFO [RS:1;jenkins-hbase4:35063] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:02:46,870 DEBUG [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/WALs/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:46,881 DEBUG [RS:0;jenkins-hbase4:41961] zookeeper.ZKUtil(162): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:46,881 DEBUG [RS:1;jenkins-hbase4:35063] zookeeper.ZKUtil(162): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:46,881 DEBUG [RS:0;jenkins-hbase4:41961] zookeeper.ZKUtil(162): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:46,881 DEBUG [RS:1;jenkins-hbase4:35063] zookeeper.ZKUtil(162): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:46,894 DEBUG [RS:1;jenkins-hbase4:35063] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:02:46,894 DEBUG [RS:0;jenkins-hbase4:41961] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:02:46,904 INFO [RS:0;jenkins-hbase4:41961] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:02:46,904 INFO [RS:1;jenkins-hbase4:35063] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:02:46,926 INFO [RS:0;jenkins-hbase4:41961] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:02:46,928 INFO [RS:1;jenkins-hbase4:35063] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:02:46,931 INFO [RS:1;jenkins-hbase4:35063] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:02:46,931 INFO [RS:0;jenkins-hbase4:41961] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:02:46,931 INFO [RS:1;jenkins-hbase4:35063] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,931 INFO [RS:0;jenkins-hbase4:41961] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,932 INFO [RS:0;jenkins-hbase4:41961] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:02:46,932 INFO [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:02:46,942 INFO [RS:1;jenkins-hbase4:35063] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,942 INFO [RS:0;jenkins-hbase4:41961] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,943 DEBUG [RS:1;jenkins-hbase4:35063] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,943 DEBUG [RS:0;jenkins-hbase4:41961] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,943 DEBUG [RS:1;jenkins-hbase4:35063] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,943 DEBUG [RS:0;jenkins-hbase4:41961] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,943 DEBUG [RS:1;jenkins-hbase4:35063] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,943 DEBUG [RS:0;jenkins-hbase4:41961] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,943 DEBUG [RS:1;jenkins-hbase4:35063] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,943 DEBUG [RS:0;jenkins-hbase4:41961] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,944 DEBUG [RS:1;jenkins-hbase4:35063] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,944 DEBUG [RS:0;jenkins-hbase4:41961] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,944 DEBUG [RS:1;jenkins-hbase4:35063] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:02:46,944 DEBUG [RS:0;jenkins-hbase4:41961] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:02:46,944 DEBUG [RS:1;jenkins-hbase4:35063] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,944 DEBUG [RS:0;jenkins-hbase4:41961] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,944 DEBUG [RS:1;jenkins-hbase4:35063] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,944 DEBUG [RS:0;jenkins-hbase4:41961] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,944 DEBUG [RS:1;jenkins-hbase4:35063] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,944 DEBUG [RS:0;jenkins-hbase4:41961] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,944 DEBUG [RS:1;jenkins-hbase4:35063] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,944 DEBUG [RS:0;jenkins-hbase4:41961] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:02:46,946 INFO [RS:1;jenkins-hbase4:35063] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,946 INFO [RS:0;jenkins-hbase4:41961] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,946 INFO [RS:1;jenkins-hbase4:35063] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,946 INFO [RS:0;jenkins-hbase4:41961] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,947 INFO [RS:1;jenkins-hbase4:35063] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,947 INFO [RS:0;jenkins-hbase4:41961] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,964 INFO [RS:0;jenkins-hbase4:41961] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:02:46,964 INFO [RS:1;jenkins-hbase4:35063] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:02:46,968 INFO [RS:1;jenkins-hbase4:35063] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35063,1675839765615-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,968 INFO [RS:0;jenkins-hbase4:41961] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41961,1675839765567-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:46,986 INFO [RS:1;jenkins-hbase4:35063] regionserver.Replication(203): jenkins-hbase4.apache.org,35063,1675839765615 started 2023-02-08 07:02:46,986 INFO [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35063,1675839765615, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35063, sessionid=0x10032bd5def0002 2023-02-08 07:02:46,986 DEBUG [RS:1;jenkins-hbase4:35063] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:02:46,986 DEBUG [RS:1;jenkins-hbase4:35063] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:46,986 DEBUG [RS:1;jenkins-hbase4:35063] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35063,1675839765615' 2023-02-08 07:02:46,986 DEBUG [RS:1;jenkins-hbase4:35063] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:02:46,987 INFO [RS:0;jenkins-hbase4:41961] regionserver.Replication(203): jenkins-hbase4.apache.org,41961,1675839765567 started 2023-02-08 07:02:46,987 DEBUG [RS:1;jenkins-hbase4:35063] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:02:46,987 INFO [RS:0;jenkins-hbase4:41961] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41961,1675839765567, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41961, sessionid=0x10032bd5def0001 2023-02-08 07:02:46,988 DEBUG [RS:0;jenkins-hbase4:41961] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:02:46,988 DEBUG [RS:0;jenkins-hbase4:41961] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:46,988 DEBUG [RS:0;jenkins-hbase4:41961] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41961,1675839765567' 2023-02-08 07:02:46,989 DEBUG [RS:1;jenkins-hbase4:35063] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:02:46,989 DEBUG [RS:1;jenkins-hbase4:35063] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:02:46,989 DEBUG [RS:0;jenkins-hbase4:41961] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:02:46,989 DEBUG [RS:1;jenkins-hbase4:35063] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:46,989 DEBUG [RS:1;jenkins-hbase4:35063] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35063,1675839765615' 2023-02-08 07:02:46,989 DEBUG [RS:1;jenkins-hbase4:35063] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:02:46,989 DEBUG [RS:1;jenkins-hbase4:35063] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:02:46,989 DEBUG [RS:0;jenkins-hbase4:41961] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:02:46,990 DEBUG [RS:0;jenkins-hbase4:41961] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:02:46,990 DEBUG [RS:1;jenkins-hbase4:35063] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:02:46,990 DEBUG [RS:0;jenkins-hbase4:41961] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:02:46,990 INFO [RS:1;jenkins-hbase4:35063] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:02:46,990 DEBUG [RS:0;jenkins-hbase4:41961] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:46,991 INFO [RS:1;jenkins-hbase4:35063] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:02:46,991 DEBUG [RS:0;jenkins-hbase4:41961] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41961,1675839765567' 2023-02-08 07:02:46,991 DEBUG [RS:0;jenkins-hbase4:41961] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:02:46,992 DEBUG [RS:0;jenkins-hbase4:41961] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:02:46,992 DEBUG [RS:0;jenkins-hbase4:41961] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:02:46,992 INFO [RS:0;jenkins-hbase4:41961] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:02:46,993 INFO [RS:0;jenkins-hbase4:41961] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:02:47,017 DEBUG [jenkins-hbase4:40701] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 07:02:47,023 DEBUG [jenkins-hbase4:40701] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:02:47,029 DEBUG [jenkins-hbase4:40701] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:02:47,029 DEBUG [jenkins-hbase4:40701] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:02:47,029 DEBUG [jenkins-hbase4:40701] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:02:47,032 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35063,1675839765615, state=OPENING 2023-02-08 07:02:47,039 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 07:02:47,040 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:02:47,041 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:02:47,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35063,1675839765615}] 2023-02-08 07:02:47,230 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:47,233 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:02:47,236 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48216, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:02:47,248 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 07:02:47,248 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:02:47,252 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35063%2C1675839765615.meta, suffix=.meta, logDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/WALs/jenkins-hbase4.apache.org,35063,1675839765615, archiveDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/oldWALs, maxLogs=32 2023-02-08 07:02:47,272 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36837,DS-36424b27-d441-4e98-b345-b9c51daea85e,DISK] 2023-02-08 07:02:47,272 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46033,DS-ec473ffb-c04c-433a-bfc3-efb6105100d5,DISK] 2023-02-08 07:02:47,276 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/WALs/jenkins-hbase4.apache.org,35063,1675839765615/jenkins-hbase4.apache.org%2C35063%2C1675839765615.meta.1675839767255.meta 2023-02-08 07:02:47,277 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36837,DS-36424b27-d441-4e98-b345-b9c51daea85e,DISK], DatanodeInfoWithStorage[127.0.0.1:46033,DS-ec473ffb-c04c-433a-bfc3-efb6105100d5,DISK]] 2023-02-08 07:02:47,278 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:02:47,279 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 07:02:47,297 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 07:02:47,302 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 07:02:47,307 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 07:02:47,307 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:47,307 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 07:02:47,308 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 07:02:47,310 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:02:47,312 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/info 2023-02-08 07:02:47,312 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/info 2023-02-08 07:02:47,313 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:02:47,314 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:47,314 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:02:47,316 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:02:47,316 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:02:47,316 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:02:47,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:47,318 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:02:47,319 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/table 2023-02-08 07:02:47,319 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/table 2023-02-08 07:02:47,320 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:02:47,321 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:47,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740 2023-02-08 07:02:47,327 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740 2023-02-08 07:02:47,337 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:02:47,341 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:02:47,343 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68804940, jitterRate=0.025273501873016357}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:02:47,343 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675839767308Writing region info on filesystem at 1675839767308Initializing all the Stores at 1675839767310 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839767310Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839767310Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839767310Cleaning up temporary data from old regions at 1675839767335 (+25 ms)Cleaning up detritus from prior splits at 1675839767336 (+1 ms)Running coprocessor post-open hooks at 1675839767343 (+7 ms)Region opened successfully at 1675839767343 2023-02-08 07:02:47,354 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675839767222 2023-02-08 07:02:47,377 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 07:02:47,378 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 07:02:47,378 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35063,1675839765615, state=OPEN 2023-02-08 07:02:47,383 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 07:02:47,383 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:02:47,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 07:02:47,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35063,1675839765615 in 338 msec 2023-02-08 07:02:47,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 07:02:47,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 548 msec 2023-02-08 07:02:47,402 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 789 msec 2023-02-08 07:02:47,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675839765669, completionTime=-1 2023-02-08 07:02:47,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 07:02:47,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 07:02:47,474 DEBUG [hconnection-0x2c54fc6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:02:47,477 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48228, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:02:47,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 07:02:47,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675839827496 2023-02-08 07:02:47,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675839887496 2023-02-08 07:02:47,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 93 msec 2023-02-08 07:02:47,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40701,1675839764394-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:47,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40701,1675839764394-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:47,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40701,1675839764394-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:47,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40701, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:47,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 07:02:47,533 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 07:02:47,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 07:02:47,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:02:47,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 07:02:47,556 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:02:47,558 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:02:47,580 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5 2023-02-08 07:02:47,583 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5 empty. 2023-02-08 07:02:47,583 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5 2023-02-08 07:02:47,584 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 07:02:47,640 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 07:02:47,648 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ab83db048ce8d4be0c3f9637ed8c6ed5, NAME => 'hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp 2023-02-08 07:02:47,693 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:47,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ab83db048ce8d4be0c3f9637ed8c6ed5, disabling compactions & flushes 2023-02-08 07:02:47,694 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. 2023-02-08 07:02:47,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. 2023-02-08 07:02:47,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. after waiting 0 ms 2023-02-08 07:02:47,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. 2023-02-08 07:02:47,695 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. 2023-02-08 07:02:47,695 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ab83db048ce8d4be0c3f9637ed8c6ed5: Waiting for close lock at 1675839767694Disabling compacts and flushes for region at 1675839767694Disabling writes for close at 1675839767694Writing region close event to WAL at 1675839767694Closed at 1675839767694 2023-02-08 07:02:47,700 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:02:47,715 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839767703"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839767703"}]},"ts":"1675839767703"} 2023-02-08 07:02:47,743 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 07:02:47,745 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:02:47,750 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839767746"}]},"ts":"1675839767746"} 2023-02-08 07:02:47,755 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 07:02:47,760 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:02:47,761 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:02:47,761 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:02:47,761 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:02:47,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ab83db048ce8d4be0c3f9637ed8c6ed5, ASSIGN}] 2023-02-08 07:02:47,768 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ab83db048ce8d4be0c3f9637ed8c6ed5, ASSIGN 2023-02-08 07:02:47,771 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ab83db048ce8d4be0c3f9637ed8c6ed5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35063,1675839765615; forceNewPlan=false, retain=false 2023-02-08 07:02:47,923 INFO [jenkins-hbase4:40701] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 07:02:47,924 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ab83db048ce8d4be0c3f9637ed8c6ed5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:47,925 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839767924"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839767924"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839767924"}]},"ts":"1675839767924"} 2023-02-08 07:02:47,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ab83db048ce8d4be0c3f9637ed8c6ed5, server=jenkins-hbase4.apache.org,35063,1675839765615}] 2023-02-08 07:02:48,002 INFO [RS:0;jenkins-hbase4:41961] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41961%2C1675839765567, suffix=, logDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/WALs/jenkins-hbase4.apache.org,41961,1675839765567, archiveDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/oldWALs, maxLogs=32 2023-02-08 07:02:48,003 INFO [RS:1;jenkins-hbase4:35063] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35063%2C1675839765615, suffix=, logDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/WALs/jenkins-hbase4.apache.org,35063,1675839765615, archiveDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/oldWALs, maxLogs=32 2023-02-08 07:02:48,026 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36837,DS-36424b27-d441-4e98-b345-b9c51daea85e,DISK] 2023-02-08 07:02:48,026 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46033,DS-ec473ffb-c04c-433a-bfc3-efb6105100d5,DISK] 2023-02-08 07:02:48,028 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36837,DS-36424b27-d441-4e98-b345-b9c51daea85e,DISK] 2023-02-08 07:02:48,028 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46033,DS-ec473ffb-c04c-433a-bfc3-efb6105100d5,DISK] 2023-02-08 07:02:48,039 INFO [RS:0;jenkins-hbase4:41961] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/WALs/jenkins-hbase4.apache.org,41961,1675839765567/jenkins-hbase4.apache.org%2C41961%2C1675839765567.1675839768004 2023-02-08 07:02:48,039 INFO [RS:1;jenkins-hbase4:35063] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/WALs/jenkins-hbase4.apache.org,35063,1675839765615/jenkins-hbase4.apache.org%2C35063%2C1675839765615.1675839768005 2023-02-08 07:02:48,039 DEBUG [RS:0;jenkins-hbase4:41961] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36837,DS-36424b27-d441-4e98-b345-b9c51daea85e,DISK], DatanodeInfoWithStorage[127.0.0.1:46033,DS-ec473ffb-c04c-433a-bfc3-efb6105100d5,DISK]] 2023-02-08 07:02:48,040 DEBUG [RS:1;jenkins-hbase4:35063] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46033,DS-ec473ffb-c04c-433a-bfc3-efb6105100d5,DISK], DatanodeInfoWithStorage[127.0.0.1:36837,DS-36424b27-d441-4e98-b345-b9c51daea85e,DISK]] 2023-02-08 07:02:48,093 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. 2023-02-08 07:02:48,094 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ab83db048ce8d4be0c3f9637ed8c6ed5, NAME => 'hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:02:48,095 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ab83db048ce8d4be0c3f9637ed8c6ed5 2023-02-08 07:02:48,095 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:48,095 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ab83db048ce8d4be0c3f9637ed8c6ed5 2023-02-08 07:02:48,095 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ab83db048ce8d4be0c3f9637ed8c6ed5 2023-02-08 07:02:48,100 INFO [StoreOpener-ab83db048ce8d4be0c3f9637ed8c6ed5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ab83db048ce8d4be0c3f9637ed8c6ed5 2023-02-08 07:02:48,102 DEBUG [StoreOpener-ab83db048ce8d4be0c3f9637ed8c6ed5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5/info 2023-02-08 07:02:48,103 DEBUG [StoreOpener-ab83db048ce8d4be0c3f9637ed8c6ed5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5/info 2023-02-08 07:02:48,103 INFO [StoreOpener-ab83db048ce8d4be0c3f9637ed8c6ed5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab83db048ce8d4be0c3f9637ed8c6ed5 columnFamilyName info 2023-02-08 07:02:48,104 INFO [StoreOpener-ab83db048ce8d4be0c3f9637ed8c6ed5-1] regionserver.HStore(310): Store=ab83db048ce8d4be0c3f9637ed8c6ed5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:48,106 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5 2023-02-08 07:02:48,107 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5 2023-02-08 07:02:48,119 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ab83db048ce8d4be0c3f9637ed8c6ed5 2023-02-08 07:02:48,130 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:48,131 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ab83db048ce8d4be0c3f9637ed8c6ed5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64954451, jitterRate=-0.03210325539112091}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:02:48,132 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ab83db048ce8d4be0c3f9637ed8c6ed5: Running coprocessor pre-open hook at 1675839768095Writing region info on filesystem at 1675839768095Initializing all the Stores at 1675839768097 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839768097Cleaning up temporary data from old regions at 1675839768108 (+11 ms)Cleaning up detritus from prior splits at 1675839768108Running coprocessor post-open hooks at 1675839768131 (+23 ms)Region opened successfully at 1675839768131 2023-02-08 07:02:48,134 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5., pid=6, masterSystemTime=1675839768084 2023-02-08 07:02:48,140 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. 2023-02-08 07:02:48,140 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. 2023-02-08 07:02:48,142 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ab83db048ce8d4be0c3f9637ed8c6ed5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:48,142 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839768141"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839768141"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839768141"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839768141"}]},"ts":"1675839768141"} 2023-02-08 07:02:48,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 07:02:48,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ab83db048ce8d4be0c3f9637ed8c6ed5, server=jenkins-hbase4.apache.org,35063,1675839765615 in 218 msec 2023-02-08 07:02:48,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 07:02:48,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ab83db048ce8d4be0c3f9637ed8c6ed5, ASSIGN in 388 msec 2023-02-08 07:02:48,158 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:02:48,159 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839768159"}]},"ts":"1675839768159"} 2023-02-08 07:02:48,165 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 07:02:48,170 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:02:48,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 626 msec 2023-02-08 07:02:48,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 07:02:48,258 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:02:48,258 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:02:48,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 07:02:48,320 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:02:48,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-02-08 07:02:48,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 07:02:48,346 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:02:48,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-08 07:02:48,359 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 07:02:48,366 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 07:02:48,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.685sec 2023-02-08 07:02:48,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 07:02:48,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 07:02:48,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 07:02:48,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40701,1675839764394-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 07:02:48,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40701,1675839764394-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 07:02:48,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 07:02:48,452 DEBUG [Listener at localhost/32917] zookeeper.ReadOnlyZKClient(139): Connect 0x437773fd to 127.0.0.1:54762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:02:48,458 DEBUG [Listener at localhost/32917] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ef65de3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:02:48,499 DEBUG [hconnection-0x538229c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:02:48,512 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48232, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:02:48,526 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40701,1675839764394 2023-02-08 07:02:48,527 DEBUG [Listener at localhost/32917] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 07:02:48,529 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:48,529 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:48,539 DEBUG [Listener at localhost/32917] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 07:02:48,543 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41614, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 07:02:48,548 INFO [Listener at localhost/32917] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-08 07:02:48,553 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-08 07:02:48,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 07:02:48,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:41614 deadline: 1675839828552, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-08 07:02:48,572 INFO [Listener at localhost/32917] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-08 07:02:48,573 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:48,573 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:48,585 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:02:48,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-08 07:02:48,589 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:02:48,592 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:02:48,594 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-08 07:02:48,602 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:48,603 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:48,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:02:48,615 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:48,615 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:48,615 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:48,616 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:48,616 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa empty. 2023-02-08 07:02:48,616 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:48,617 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:48,617 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:48,617 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:48,617 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1 empty. 2023-02-08 07:02:48,617 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217 empty. 2023-02-08 07:02:48,619 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50 empty. 2023-02-08 07:02:48,619 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:48,619 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:48,619 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c empty. 2023-02-08 07:02:48,620 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba empty. 2023-02-08 07:02:48,620 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44 empty. 2023-02-08 07:02:48,621 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:48,621 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:48,621 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671 empty. 2023-02-08 07:02:48,621 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:48,621 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:48,621 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:48,621 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:48,622 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f empty. 2023-02-08 07:02:48,621 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d empty. 2023-02-08 07:02:48,622 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:48,622 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:48,622 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:48,623 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:48,623 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-08 07:02:48,649 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-08 07:02:48,652 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 00061a9a43bd799484ccc17c89947e50, NAME => 'testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp 2023-02-08 07:02:48,652 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 81797aa7b2c7e5c03d341ad6d4b22cfa, NAME => 'testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp 2023-02-08 07:02:48,652 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 63a9a028567d15ba686c122d4dc3a217, NAME => 'testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp 2023-02-08 07:02:48,714 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:48,715 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:48,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:02:48,728 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:48,728 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:48,728 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 63a9a028567d15ba686c122d4dc3a217, disabling compactions & flushes 2023-02-08 07:02:48,728 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 81797aa7b2c7e5c03d341ad6d4b22cfa, disabling compactions & flushes 2023-02-08 07:02:48,728 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:48,728 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:48,728 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:48,728 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:48,728 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. after waiting 0 ms 2023-02-08 07:02:48,728 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. after waiting 0 ms 2023-02-08 07:02:48,728 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:48,728 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:48,728 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:48,729 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:48,729 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:48,729 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 81797aa7b2c7e5c03d341ad6d4b22cfa: Waiting for close lock at 1675839768728Disabling compacts and flushes for region at 1675839768728Disabling writes for close at 1675839768728Writing region close event to WAL at 1675839768729 (+1 ms)Closed at 1675839768729 2023-02-08 07:02:48,729 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 00061a9a43bd799484ccc17c89947e50, disabling compactions & flushes 2023-02-08 07:02:48,729 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 63a9a028567d15ba686c122d4dc3a217: Waiting for close lock at 1675839768728Disabling compacts and flushes for region at 1675839768728Disabling writes for close at 1675839768728Writing region close event to WAL at 1675839768729 (+1 ms)Closed at 1675839768729 2023-02-08 07:02:48,730 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e5f360121ad077c24ab1da4ed41793d1, NAME => 'testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp 2023-02-08 07:02:48,730 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:48,730 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:48,730 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. after waiting 0 ms 2023-02-08 07:02:48,730 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0ff96987c3f42b10504e567f52ec0b44, NAME => 'testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp 2023-02-08 07:02:48,730 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:48,731 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:48,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 00061a9a43bd799484ccc17c89947e50: Waiting for close lock at 1675839768729Disabling compacts and flushes for region at 1675839768729Disabling writes for close at 1675839768730 (+1 ms)Writing region close event to WAL at 1675839768731 (+1 ms)Closed at 1675839768731 2023-02-08 07:02:48,731 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => cf462321411027fc65d6e0abc079dbba, NAME => 'testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp 2023-02-08 07:02:48,774 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:48,776 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 0ff96987c3f42b10504e567f52ec0b44, disabling compactions & flushes 2023-02-08 07:02:48,776 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:48,776 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:48,776 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. after waiting 0 ms 2023-02-08 07:02:48,776 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:48,776 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:48,776 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 0ff96987c3f42b10504e567f52ec0b44: Waiting for close lock at 1675839768776Disabling compacts and flushes for region at 1675839768776Disabling writes for close at 1675839768776Writing region close event to WAL at 1675839768776Closed at 1675839768776 2023-02-08 07:02:48,777 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 87858cdb09f5de238cd652bb0c760c8f, NAME => 'testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp 2023-02-08 07:02:48,790 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:48,791 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 87858cdb09f5de238cd652bb0c760c8f, disabling compactions & flushes 2023-02-08 07:02:48,791 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:48,791 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:48,791 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. after waiting 0 ms 2023-02-08 07:02:48,791 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:48,791 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:48,791 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 87858cdb09f5de238cd652bb0c760c8f: Waiting for close lock at 1675839768791Disabling compacts and flushes for region at 1675839768791Disabling writes for close at 1675839768791Writing region close event to WAL at 1675839768791Closed at 1675839768791 2023-02-08 07:02:48,791 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => d5df91c41ae95ce6206bc1458402cd2c, NAME => 'testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp 2023-02-08 07:02:48,803 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:48,803 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing d5df91c41ae95ce6206bc1458402cd2c, disabling compactions & flushes 2023-02-08 07:02:48,803 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:48,803 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:48,803 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. after waiting 0 ms 2023-02-08 07:02:48,804 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:48,804 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:48,804 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for d5df91c41ae95ce6206bc1458402cd2c: Waiting for close lock at 1675839768803Disabling compacts and flushes for region at 1675839768803Disabling writes for close at 1675839768804 (+1 ms)Writing region close event to WAL at 1675839768804Closed at 1675839768804 2023-02-08 07:02:48,804 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3bba034a798e8ebbcd952eeea7bc0671, NAME => 'testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp 2023-02-08 07:02:48,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:48,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 3bba034a798e8ebbcd952eeea7bc0671, disabling compactions & flushes 2023-02-08 07:02:48,815 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:48,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:48,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. after waiting 0 ms 2023-02-08 07:02:48,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:48,815 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:48,816 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 3bba034a798e8ebbcd952eeea7bc0671: Waiting for close lock at 1675839768815Disabling compacts and flushes for region at 1675839768815Disabling writes for close at 1675839768815Writing region close event to WAL at 1675839768815Closed at 1675839768815 2023-02-08 07:02:48,816 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ccb06f81840bf3b7fd0ca95472b51e8d, NAME => 'testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp 2023-02-08 07:02:48,830 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:48,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ccb06f81840bf3b7fd0ca95472b51e8d, disabling compactions & flushes 2023-02-08 07:02:48,831 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:48,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:48,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. after waiting 0 ms 2023-02-08 07:02:48,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:48,831 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:48,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ccb06f81840bf3b7fd0ca95472b51e8d: Waiting for close lock at 1675839768831Disabling compacts and flushes for region at 1675839768831Disabling writes for close at 1675839768831Writing region close event to WAL at 1675839768831Closed at 1675839768831 2023-02-08 07:02:48,928 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:48,929 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:48,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:02:49,170 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:49,170 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e5f360121ad077c24ab1da4ed41793d1, disabling compactions & flushes 2023-02-08 07:02:49,170 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:49,170 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:49,170 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. after waiting 0 ms 2023-02-08 07:02:49,170 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:49,170 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:49,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:49,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e5f360121ad077c24ab1da4ed41793d1: Waiting for close lock at 1675839769170Disabling compacts and flushes for region at 1675839769170Disabling writes for close at 1675839769170Writing region close event to WAL at 1675839769170Closed at 1675839769170 2023-02-08 07:02:49,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing cf462321411027fc65d6e0abc079dbba, disabling compactions & flushes 2023-02-08 07:02:49,171 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:49,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:49,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. after waiting 0 ms 2023-02-08 07:02:49,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:49,171 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:49,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for cf462321411027fc65d6e0abc079dbba: Waiting for close lock at 1675839769171Disabling compacts and flushes for region at 1675839769171Disabling writes for close at 1675839769171Writing region close event to WAL at 1675839769171Closed at 1675839769171 2023-02-08 07:02:49,177 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:02:49,178 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839769178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839769178"}]},"ts":"1675839769178"} 2023-02-08 07:02:49,178 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839769178"}]},"ts":"1675839769178"} 2023-02-08 07:02:49,178 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839769178"}]},"ts":"1675839769178"} 2023-02-08 07:02:49,179 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839769178"}]},"ts":"1675839769178"} 2023-02-08 07:02:49,179 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839769178"}]},"ts":"1675839769178"} 2023-02-08 07:02:49,179 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839769178"}]},"ts":"1675839769178"} 2023-02-08 07:02:49,179 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839769178"}]},"ts":"1675839769178"} 2023-02-08 07:02:49,179 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839769178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839769178"}]},"ts":"1675839769178"} 2023-02-08 07:02:49,179 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839769178"}]},"ts":"1675839769178"} 2023-02-08 07:02:49,179 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839769178"}]},"ts":"1675839769178"} 2023-02-08 07:02:49,226 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-08 07:02:49,227 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:02:49,228 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839769228"}]},"ts":"1675839769228"} 2023-02-08 07:02:49,230 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-08 07:02:49,231 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:49,232 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:49,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:02:49,236 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:02:49,256 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:02:49,256 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:02:49,256 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:02:49,257 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=81797aa7b2c7e5c03d341ad6d4b22cfa, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=63a9a028567d15ba686c122d4dc3a217, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=00061a9a43bd799484ccc17c89947e50, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e5f360121ad077c24ab1da4ed41793d1, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0ff96987c3f42b10504e567f52ec0b44, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cf462321411027fc65d6e0abc079dbba, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=87858cdb09f5de238cd652bb0c760c8f, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d5df91c41ae95ce6206bc1458402cd2c, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3bba034a798e8ebbcd952eeea7bc0671, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ccb06f81840bf3b7fd0ca95472b51e8d, ASSIGN}] 2023-02-08 07:02:49,263 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e5f360121ad077c24ab1da4ed41793d1, ASSIGN 2023-02-08 07:02:49,264 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=63a9a028567d15ba686c122d4dc3a217, ASSIGN 2023-02-08 07:02:49,265 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=81797aa7b2c7e5c03d341ad6d4b22cfa, ASSIGN 2023-02-08 07:02:49,265 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=00061a9a43bd799484ccc17c89947e50, ASSIGN 2023-02-08 07:02:49,275 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e5f360121ad077c24ab1da4ed41793d1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35063,1675839765615; forceNewPlan=false, retain=false 2023-02-08 07:02:49,275 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=81797aa7b2c7e5c03d341ad6d4b22cfa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35063,1675839765615; forceNewPlan=false, retain=false 2023-02-08 07:02:49,276 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=00061a9a43bd799484ccc17c89947e50, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35063,1675839765615; forceNewPlan=false, retain=false 2023-02-08 07:02:49,276 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ccb06f81840bf3b7fd0ca95472b51e8d, ASSIGN 2023-02-08 07:02:49,279 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=63a9a028567d15ba686c122d4dc3a217, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41961,1675839765567; forceNewPlan=false, retain=false 2023-02-08 07:02:49,279 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ccb06f81840bf3b7fd0ca95472b51e8d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41961,1675839765567; forceNewPlan=false, retain=false 2023-02-08 07:02:49,279 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3bba034a798e8ebbcd952eeea7bc0671, ASSIGN 2023-02-08 07:02:49,280 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d5df91c41ae95ce6206bc1458402cd2c, ASSIGN 2023-02-08 07:02:49,280 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=87858cdb09f5de238cd652bb0c760c8f, ASSIGN 2023-02-08 07:02:49,281 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cf462321411027fc65d6e0abc079dbba, ASSIGN 2023-02-08 07:02:49,281 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0ff96987c3f42b10504e567f52ec0b44, ASSIGN 2023-02-08 07:02:49,282 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3bba034a798e8ebbcd952eeea7bc0671, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35063,1675839765615; forceNewPlan=false, retain=false 2023-02-08 07:02:49,282 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d5df91c41ae95ce6206bc1458402cd2c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41961,1675839765567; forceNewPlan=false, retain=false 2023-02-08 07:02:49,282 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=87858cdb09f5de238cd652bb0c760c8f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35063,1675839765615; forceNewPlan=false, retain=false 2023-02-08 07:02:49,283 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cf462321411027fc65d6e0abc079dbba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41961,1675839765567; forceNewPlan=false, retain=false 2023-02-08 07:02:49,284 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0ff96987c3f42b10504e567f52ec0b44, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41961,1675839765567; forceNewPlan=false, retain=false 2023-02-08 07:02:49,425 INFO [jenkins-hbase4:40701] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-08 07:02:49,428 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cf462321411027fc65d6e0abc079dbba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:49,428 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=63a9a028567d15ba686c122d4dc3a217, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:49,428 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=d5df91c41ae95ce6206bc1458402cd2c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:49,428 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0ff96987c3f42b10504e567f52ec0b44, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:49,429 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839769428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839769428"}]},"ts":"1675839769428"} 2023-02-08 07:02:49,429 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839769428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839769428"}]},"ts":"1675839769428"} 2023-02-08 07:02:49,428 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ccb06f81840bf3b7fd0ca95472b51e8d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:49,429 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839769428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839769428"}]},"ts":"1675839769428"} 2023-02-08 07:02:49,429 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839769428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839769428"}]},"ts":"1675839769428"} 2023-02-08 07:02:49,429 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839769428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839769428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839769428"}]},"ts":"1675839769428"} 2023-02-08 07:02:49,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure cf462321411027fc65d6e0abc079dbba, server=jenkins-hbase4.apache.org,41961,1675839765567}] 2023-02-08 07:02:49,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure 63a9a028567d15ba686c122d4dc3a217, server=jenkins-hbase4.apache.org,41961,1675839765567}] 2023-02-08 07:02:49,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure 0ff96987c3f42b10504e567f52ec0b44, server=jenkins-hbase4.apache.org,41961,1675839765567}] 2023-02-08 07:02:49,438 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure d5df91c41ae95ce6206bc1458402cd2c, server=jenkins-hbase4.apache.org,41961,1675839765567}] 2023-02-08 07:02:49,439 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=00061a9a43bd799484ccc17c89947e50, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:49,439 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839769439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839769439"}]},"ts":"1675839769439"} 2023-02-08 07:02:49,440 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure ccb06f81840bf3b7fd0ca95472b51e8d, server=jenkins-hbase4.apache.org,41961,1675839765567}] 2023-02-08 07:02:49,441 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=87858cdb09f5de238cd652bb0c760c8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:49,442 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769441"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839769441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839769441"}]},"ts":"1675839769441"} 2023-02-08 07:02:49,443 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 00061a9a43bd799484ccc17c89947e50, server=jenkins-hbase4.apache.org,35063,1675839765615}] 2023-02-08 07:02:49,444 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=81797aa7b2c7e5c03d341ad6d4b22cfa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:49,444 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839769444"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839769444"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839769444"}]},"ts":"1675839769444"} 2023-02-08 07:02:49,446 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e5f360121ad077c24ab1da4ed41793d1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:49,446 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769446"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839769446"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839769446"}]},"ts":"1675839769446"} 2023-02-08 07:02:49,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure 87858cdb09f5de238cd652bb0c760c8f, server=jenkins-hbase4.apache.org,35063,1675839765615}] 2023-02-08 07:02:49,448 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=11, state=RUNNABLE; OpenRegionProcedure 81797aa7b2c7e5c03d341ad6d4b22cfa, server=jenkins-hbase4.apache.org,35063,1675839765615}] 2023-02-08 07:02:49,448 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=3bba034a798e8ebbcd952eeea7bc0671, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:49,448 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769448"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839769448"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839769448"}]},"ts":"1675839769448"} 2023-02-08 07:02:49,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure e5f360121ad077c24ab1da4ed41793d1, server=jenkins-hbase4.apache.org,35063,1675839765615}] 2023-02-08 07:02:49,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=19, state=RUNNABLE; OpenRegionProcedure 3bba034a798e8ebbcd952eeea7bc0671, server=jenkins-hbase4.apache.org,35063,1675839765615}] 2023-02-08 07:02:49,586 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:49,586 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:02:49,590 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59402, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:02:49,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:49,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0ff96987c3f42b10504e567f52ec0b44, NAME => 'testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-08 07:02:49,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:49,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:49,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:49,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:49,600 INFO [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:49,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:49,602 DEBUG [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1 2023-02-08 07:02:49,602 DEBUG [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1 2023-02-08 07:02:49,603 INFO [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ff96987c3f42b10504e567f52ec0b44 columnFamilyName f1 2023-02-08 07:02:49,604 INFO [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] regionserver.HStore(310): Store=0ff96987c3f42b10504e567f52ec0b44/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,604 INFO [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:49,606 DEBUG [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2 2023-02-08 07:02:49,606 DEBUG [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2 2023-02-08 07:02:49,606 INFO [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ff96987c3f42b10504e567f52ec0b44 columnFamilyName f2 2023-02-08 07:02:49,607 INFO [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] regionserver.HStore(310): Store=0ff96987c3f42b10504e567f52ec0b44/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 81797aa7b2c7e5c03d341ad6d4b22cfa, NAME => 'testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-08 07:02:49,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:49,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:49,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:49,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:49,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:49,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:49,613 INFO [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:49,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:49,615 DEBUG [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/f1 2023-02-08 07:02:49,615 DEBUG [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/f1 2023-02-08 07:02:49,616 INFO [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81797aa7b2c7e5c03d341ad6d4b22cfa columnFamilyName f1 2023-02-08 07:02:49,617 INFO [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] regionserver.HStore(310): Store=81797aa7b2c7e5c03d341ad6d4b22cfa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,617 INFO [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:49,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:49,621 DEBUG [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/f2 2023-02-08 07:02:49,621 DEBUG [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/f2 2023-02-08 07:02:49,621 INFO [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81797aa7b2c7e5c03d341ad6d4b22cfa columnFamilyName f2 2023-02-08 07:02:49,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:49,622 INFO [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] regionserver.HStore(310): Store=81797aa7b2c7e5c03d341ad6d4b22cfa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0ff96987c3f42b10504e567f52ec0b44; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73257262, jitterRate=0.09161826968193054}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:49,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0ff96987c3f42b10504e567f52ec0b44: Running coprocessor pre-open hook at 1675839769597Writing region info on filesystem at 1675839769597Initializing all the Stores at 1675839769598 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769599 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769599Cleaning up temporary data from old regions at 1675839769613 (+14 ms)Cleaning up detritus from prior splits at 1675839769613Running coprocessor post-open hooks at 1675839769623 (+10 ms)Region opened successfully at 1675839769623 2023-02-08 07:02:49,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:49,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44., pid=23, masterSystemTime=1675839769586 2023-02-08 07:02:49,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:49,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:49,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:49,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:49,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:49,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 63a9a028567d15ba686c122d4dc3a217, NAME => 'testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-08 07:02:49,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:49,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:49,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:49,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:49,640 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0ff96987c3f42b10504e567f52ec0b44, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:49,640 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769640"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839769640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839769640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839769640"}]},"ts":"1675839769640"} 2023-02-08 07:02:49,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:49,642 INFO [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:49,647 DEBUG [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1 2023-02-08 07:02:49,647 DEBUG [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1 2023-02-08 07:02:49,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:49,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-08 07:02:49,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure 0ff96987c3f42b10504e567f52ec0b44, server=jenkins-hbase4.apache.org,41961,1675839765567 in 209 msec 2023-02-08 07:02:49,648 INFO [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63a9a028567d15ba686c122d4dc3a217 columnFamilyName f1 2023-02-08 07:02:49,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 81797aa7b2c7e5c03d341ad6d4b22cfa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59549085, jitterRate=-0.11264948546886444}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:49,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 81797aa7b2c7e5c03d341ad6d4b22cfa: Running coprocessor pre-open hook at 1675839769611Writing region info on filesystem at 1675839769611Initializing all the Stores at 1675839769612 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769612Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769613 (+1 ms)Cleaning up temporary data from old regions at 1675839769635 (+22 ms)Cleaning up detritus from prior splits at 1675839769636 (+1 ms)Running coprocessor post-open hooks at 1675839769649 (+13 ms)Region opened successfully at 1675839769649 2023-02-08 07:02:49,649 INFO [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] regionserver.HStore(310): Store=63a9a028567d15ba686c122d4dc3a217/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,650 INFO [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:49,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa., pid=28, masterSystemTime=1675839769597 2023-02-08 07:02:49,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0ff96987c3f42b10504e567f52ec0b44, ASSIGN in 391 msec 2023-02-08 07:02:49,658 DEBUG [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2 2023-02-08 07:02:49,658 DEBUG [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2 2023-02-08 07:02:49,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:49,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:49,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:49,659 INFO [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63a9a028567d15ba686c122d4dc3a217 columnFamilyName f2 2023-02-08 07:02:49,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 00061a9a43bd799484ccc17c89947e50, NAME => 'testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-08 07:02:49,659 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=81797aa7b2c7e5c03d341ad6d4b22cfa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:49,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:49,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:49,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:49,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:49,660 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839769659"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839769659"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839769659"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839769659"}]},"ts":"1675839769659"} 2023-02-08 07:02:49,660 INFO [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] regionserver.HStore(310): Store=63a9a028567d15ba686c122d4dc3a217/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,662 INFO [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:49,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:49,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:49,664 DEBUG [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1 2023-02-08 07:02:49,665 DEBUG [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1 2023-02-08 07:02:49,666 INFO [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00061a9a43bd799484ccc17c89947e50 columnFamilyName f1 2023-02-08 07:02:49,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:49,667 INFO [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] regionserver.HStore(310): Store=00061a9a43bd799484ccc17c89947e50/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,667 INFO [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:49,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=11 2023-02-08 07:02:49,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=11, state=SUCCESS; OpenRegionProcedure 81797aa7b2c7e5c03d341ad6d4b22cfa, server=jenkins-hbase4.apache.org,35063,1675839765615 in 216 msec 2023-02-08 07:02:49,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:49,671 DEBUG [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2 2023-02-08 07:02:49,671 DEBUG [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2 2023-02-08 07:02:49,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=81797aa7b2c7e5c03d341ad6d4b22cfa, ASSIGN in 413 msec 2023-02-08 07:02:49,672 INFO [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00061a9a43bd799484ccc17c89947e50 columnFamilyName f2 2023-02-08 07:02:49,673 INFO [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] regionserver.HStore(310): Store=00061a9a43bd799484ccc17c89947e50/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:49,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:49,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:49,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 63a9a028567d15ba686c122d4dc3a217; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68360350, jitterRate=0.018648594617843628}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:49,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 63a9a028567d15ba686c122d4dc3a217: Running coprocessor pre-open hook at 1675839769640Writing region info on filesystem at 1675839769640Initializing all the Stores at 1675839769641 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769641Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769642 (+1 ms)Cleaning up temporary data from old regions at 1675839769665 (+23 ms)Cleaning up detritus from prior splits at 1675839769665Running coprocessor post-open hooks at 1675839769677 (+12 ms)Region opened successfully at 1675839769677 2023-02-08 07:02:49,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217., pid=22, masterSystemTime=1675839769586 2023-02-08 07:02:49,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:49,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:49,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:49,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:49,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d5df91c41ae95ce6206bc1458402cd2c, NAME => 'testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-08 07:02:49,684 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=63a9a028567d15ba686c122d4dc3a217, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:49,684 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769684"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839769684"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839769684"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839769684"}]},"ts":"1675839769684"} 2023-02-08 07:02:49,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:49,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:49,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:49,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:49,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:49,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-08 07:02:49,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure 63a9a028567d15ba686c122d4dc3a217, server=jenkins-hbase4.apache.org,41961,1675839765567 in 254 msec 2023-02-08 07:02:49,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=63a9a028567d15ba686c122d4dc3a217, ASSIGN in 434 msec 2023-02-08 07:02:49,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:49,696 INFO [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:49,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 00061a9a43bd799484ccc17c89947e50; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69041503, jitterRate=0.02879856526851654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:49,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 00061a9a43bd799484ccc17c89947e50: Running coprocessor pre-open hook at 1675839769660Writing region info on filesystem at 1675839769660Initializing all the Stores at 1675839769662 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769662Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769662Cleaning up temporary data from old regions at 1675839769678 (+16 ms)Cleaning up detritus from prior splits at 1675839769681 (+3 ms)Running coprocessor post-open hooks at 1675839769697 (+16 ms)Region opened successfully at 1675839769697 2023-02-08 07:02:49,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50., pid=26, masterSystemTime=1675839769597 2023-02-08 07:02:49,699 DEBUG [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1 2023-02-08 07:02:49,700 DEBUG [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1 2023-02-08 07:02:49,700 INFO [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5df91c41ae95ce6206bc1458402cd2c columnFamilyName f1 2023-02-08 07:02:49,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:49,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:49,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:49,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 87858cdb09f5de238cd652bb0c760c8f, NAME => 'testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-08 07:02:49,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:49,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:49,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:49,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:49,704 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=00061a9a43bd799484ccc17c89947e50, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:49,705 INFO [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] regionserver.HStore(310): Store=d5df91c41ae95ce6206bc1458402cd2c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,705 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769704"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839769704"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839769704"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839769704"}]},"ts":"1675839769704"} 2023-02-08 07:02:49,705 INFO [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:49,706 INFO [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:49,708 DEBUG [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2 2023-02-08 07:02:49,708 DEBUG [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2 2023-02-08 07:02:49,709 INFO [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5df91c41ae95ce6206bc1458402cd2c columnFamilyName f2 2023-02-08 07:02:49,709 DEBUG [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1 2023-02-08 07:02:49,709 DEBUG [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1 2023-02-08 07:02:49,710 INFO [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87858cdb09f5de238cd652bb0c760c8f columnFamilyName f1 2023-02-08 07:02:49,710 INFO [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] regionserver.HStore(310): Store=d5df91c41ae95ce6206bc1458402cd2c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-08 07:02:49,714 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 00061a9a43bd799484ccc17c89947e50, server=jenkins-hbase4.apache.org,35063,1675839765615 in 265 msec 2023-02-08 07:02:49,714 INFO [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] regionserver.HStore(310): Store=87858cdb09f5de238cd652bb0c760c8f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,714 INFO [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:49,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:49,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:49,716 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=00061a9a43bd799484ccc17c89947e50, ASSIGN in 457 msec 2023-02-08 07:02:49,717 DEBUG [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2 2023-02-08 07:02:49,717 DEBUG [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2 2023-02-08 07:02:49,717 INFO [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87858cdb09f5de238cd652bb0c760c8f columnFamilyName f2 2023-02-08 07:02:49,718 INFO [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] regionserver.HStore(310): Store=87858cdb09f5de238cd652bb0c760c8f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:49,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:49,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:49,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:49,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:49,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:49,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:49,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d5df91c41ae95ce6206bc1458402cd2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58905371, jitterRate=-0.12224157154560089}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:49,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d5df91c41ae95ce6206bc1458402cd2c: Running coprocessor pre-open hook at 1675839769686Writing region info on filesystem at 1675839769686Initializing all the Stores at 1675839769688 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769688Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769696 (+8 ms)Cleaning up temporary data from old regions at 1675839769717 (+21 ms)Cleaning up detritus from prior splits at 1675839769718 (+1 ms)Running coprocessor post-open hooks at 1675839769725 (+7 ms)Region opened successfully at 1675839769725 2023-02-08 07:02:49,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c., pid=24, masterSystemTime=1675839769586 2023-02-08 07:02:49,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:49,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 87858cdb09f5de238cd652bb0c760c8f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60899309, jitterRate=-0.09252957999706268}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:49,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 87858cdb09f5de238cd652bb0c760c8f: Running coprocessor pre-open hook at 1675839769703Writing region info on filesystem at 1675839769703Initializing all the Stores at 1675839769705 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769705Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769705Cleaning up temporary data from old regions at 1675839769721 (+16 ms)Cleaning up detritus from prior splits at 1675839769722 (+1 ms)Running coprocessor post-open hooks at 1675839769729 (+7 ms)Region opened successfully at 1675839769729 2023-02-08 07:02:49,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:49,731 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=d5df91c41ae95ce6206bc1458402cd2c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:49,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f., pid=27, masterSystemTime=1675839769597 2023-02-08 07:02:49,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:49,731 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769731"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839769731"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839769731"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839769731"}]},"ts":"1675839769731"} 2023-02-08 07:02:49,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:49,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ccb06f81840bf3b7fd0ca95472b51e8d, NAME => 'testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-08 07:02:49,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:49,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:49,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:49,733 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:49,734 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:49,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:49,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:49,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:49,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e5f360121ad077c24ab1da4ed41793d1, NAME => 'testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-08 07:02:49,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:49,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:02:49,735 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=87858cdb09f5de238cd652bb0c760c8f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:49,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:49,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:49,736 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769735"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839769735"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839769735"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839769735"}]},"ts":"1675839769735"} 2023-02-08 07:02:49,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:49,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:49,738 INFO [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:49,740 INFO [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:49,740 DEBUG [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/f1 2023-02-08 07:02:49,741 DEBUG [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/f1 2023-02-08 07:02:49,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-08 07:02:49,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure d5df91c41ae95ce6206bc1458402cd2c, server=jenkins-hbase4.apache.org,41961,1675839765567 in 297 msec 2023-02-08 07:02:49,741 INFO [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ccb06f81840bf3b7fd0ca95472b51e8d columnFamilyName f1 2023-02-08 07:02:49,743 INFO [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] regionserver.HStore(310): Store=ccb06f81840bf3b7fd0ca95472b51e8d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,743 DEBUG [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1 2023-02-08 07:02:49,743 INFO [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:49,743 DEBUG [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1 2023-02-08 07:02:49,743 INFO [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f360121ad077c24ab1da4ed41793d1 columnFamilyName f1 2023-02-08 07:02:49,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-08 07:02:49,744 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d5df91c41ae95ce6206bc1458402cd2c, ASSIGN in 484 msec 2023-02-08 07:02:49,745 INFO [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] regionserver.HStore(310): Store=e5f360121ad077c24ab1da4ed41793d1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,745 INFO [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:49,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure 87858cdb09f5de238cd652bb0c760c8f, server=jenkins-hbase4.apache.org,35063,1675839765615 in 294 msec 2023-02-08 07:02:49,746 DEBUG [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/f2 2023-02-08 07:02:49,747 DEBUG [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/f2 2023-02-08 07:02:49,747 INFO [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ccb06f81840bf3b7fd0ca95472b51e8d columnFamilyName f2 2023-02-08 07:02:49,747 DEBUG [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2 2023-02-08 07:02:49,748 DEBUG [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2 2023-02-08 07:02:49,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=87858cdb09f5de238cd652bb0c760c8f, ASSIGN in 487 msec 2023-02-08 07:02:49,748 INFO [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] regionserver.HStore(310): Store=ccb06f81840bf3b7fd0ca95472b51e8d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,748 INFO [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f360121ad077c24ab1da4ed41793d1 columnFamilyName f2 2023-02-08 07:02:49,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:49,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:49,752 INFO [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] regionserver.HStore(310): Store=e5f360121ad077c24ab1da4ed41793d1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:49,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:49,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:49,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:49,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:49,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:49,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:49,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ccb06f81840bf3b7fd0ca95472b51e8d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62442230, jitterRate=-0.06953826546669006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:49,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ccb06f81840bf3b7fd0ca95472b51e8d: Running coprocessor pre-open hook at 1675839769736Writing region info on filesystem at 1675839769736Initializing all the Stores at 1675839769737 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769737Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769738 (+1 ms)Cleaning up temporary data from old regions at 1675839769753 (+15 ms)Cleaning up detritus from prior splits at 1675839769754 (+1 ms)Running coprocessor post-open hooks at 1675839769762 (+8 ms)Region opened successfully at 1675839769762 2023-02-08 07:02:49,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:49,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d., pid=25, masterSystemTime=1675839769586 2023-02-08 07:02:49,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e5f360121ad077c24ab1da4ed41793d1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60728497, jitterRate=-0.09507487714290619}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:49,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e5f360121ad077c24ab1da4ed41793d1: Running coprocessor pre-open hook at 1675839769736Writing region info on filesystem at 1675839769736Initializing all the Stores at 1675839769738 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769738Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769740 (+2 ms)Cleaning up temporary data from old regions at 1675839769755 (+15 ms)Cleaning up detritus from prior splits at 1675839769756 (+1 ms)Running coprocessor post-open hooks at 1675839769765 (+9 ms)Region opened successfully at 1675839769765 2023-02-08 07:02:49,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1., pid=29, masterSystemTime=1675839769597 2023-02-08 07:02:49,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:49,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:49,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:49,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cf462321411027fc65d6e0abc079dbba, NAME => 'testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-08 07:02:49,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:49,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:49,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:49,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:49,768 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ccb06f81840bf3b7fd0ca95472b51e8d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:49,768 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839769768"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839769768"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839769768"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839769768"}]},"ts":"1675839769768"} 2023-02-08 07:02:49,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:49,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:49,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:49,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3bba034a798e8ebbcd952eeea7bc0671, NAME => 'testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-08 07:02:49,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:49,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:49,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:49,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:49,771 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e5f360121ad077c24ab1da4ed41793d1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:49,771 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769771"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839769771"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839769771"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839769771"}]},"ts":"1675839769771"} 2023-02-08 07:02:49,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-08 07:02:49,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure ccb06f81840bf3b7fd0ca95472b51e8d, server=jenkins-hbase4.apache.org,41961,1675839765567 in 333 msec 2023-02-08 07:02:49,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-08 07:02:49,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure e5f360121ad077c24ab1da4ed41793d1, server=jenkins-hbase4.apache.org,35063,1675839765615 in 320 msec 2023-02-08 07:02:49,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ccb06f81840bf3b7fd0ca95472b51e8d, ASSIGN in 519 msec 2023-02-08 07:02:49,781 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e5f360121ad077c24ab1da4ed41793d1, ASSIGN in 521 msec 2023-02-08 07:02:49,784 INFO [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:49,784 INFO [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:49,786 DEBUG [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1 2023-02-08 07:02:49,787 DEBUG [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1 2023-02-08 07:02:49,787 INFO [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf462321411027fc65d6e0abc079dbba columnFamilyName f1 2023-02-08 07:02:49,788 INFO [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] regionserver.HStore(310): Store=cf462321411027fc65d6e0abc079dbba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,788 INFO [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:49,790 DEBUG [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2 2023-02-08 07:02:49,790 DEBUG [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2 2023-02-08 07:02:49,791 INFO [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf462321411027fc65d6e0abc079dbba columnFamilyName f2 2023-02-08 07:02:49,791 INFO [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] regionserver.HStore(310): Store=cf462321411027fc65d6e0abc079dbba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:49,794 DEBUG [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1 2023-02-08 07:02:49,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:49,794 DEBUG [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1 2023-02-08 07:02:49,796 INFO [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bba034a798e8ebbcd952eeea7bc0671 columnFamilyName f1 2023-02-08 07:02:49,797 INFO [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] regionserver.HStore(310): Store=3bba034a798e8ebbcd952eeea7bc0671/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:49,797 INFO [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:49,800 DEBUG [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2 2023-02-08 07:02:49,800 DEBUG [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2 2023-02-08 07:02:49,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:49,800 INFO [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bba034a798e8ebbcd952eeea7bc0671 columnFamilyName f2 2023-02-08 07:02:49,801 INFO [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] regionserver.HStore(310): Store=3bba034a798e8ebbcd952eeea7bc0671/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:49,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:49,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:49,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:49,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cf462321411027fc65d6e0abc079dbba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62462605, jitterRate=-0.06923465430736542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:49,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cf462321411027fc65d6e0abc079dbba: Running coprocessor pre-open hook at 1675839769768Writing region info on filesystem at 1675839769768Initializing all the Stores at 1675839769773 (+5 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769773Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769784 (+11 ms)Cleaning up temporary data from old regions at 1675839769795 (+11 ms)Cleaning up detritus from prior splits at 1675839769796 (+1 ms)Running coprocessor post-open hooks at 1675839769805 (+9 ms)Region opened successfully at 1675839769805 2023-02-08 07:02:49,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba., pid=21, masterSystemTime=1675839769586 2023-02-08 07:02:49,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:49,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:49,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:49,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:49,810 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cf462321411027fc65d6e0abc079dbba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:49,810 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769810"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839769810"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839769810"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839769810"}]},"ts":"1675839769810"} 2023-02-08 07:02:49,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-08 07:02:49,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure cf462321411027fc65d6e0abc079dbba, server=jenkins-hbase4.apache.org,41961,1675839765567 in 381 msec 2023-02-08 07:02:49,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cf462321411027fc65d6e0abc079dbba, ASSIGN in 559 msec 2023-02-08 07:02:49,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:02:49,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3bba034a798e8ebbcd952eeea7bc0671; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74109032, jitterRate=0.10431063175201416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:49,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3bba034a798e8ebbcd952eeea7bc0671: Running coprocessor pre-open hook at 1675839769771Writing region info on filesystem at 1675839769771Initializing all the Stores at 1675839769773 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769773Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839769784 (+11 ms)Cleaning up temporary data from old regions at 1675839769805 (+21 ms)Cleaning up detritus from prior splits at 1675839769805Running coprocessor post-open hooks at 1675839769825 (+20 ms)Region opened successfully at 1675839769825 2023-02-08 07:02:49,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671., pid=30, masterSystemTime=1675839769597 2023-02-08 07:02:49,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:49,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:49,829 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=3bba034a798e8ebbcd952eeea7bc0671, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:49,829 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839769829"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839769829"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839769829"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839769829"}]},"ts":"1675839769829"} 2023-02-08 07:02:49,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=19 2023-02-08 07:02:49,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=19, state=SUCCESS; OpenRegionProcedure 3bba034a798e8ebbcd952eeea7bc0671, server=jenkins-hbase4.apache.org,35063,1675839765615 in 375 msec 2023-02-08 07:02:49,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-08 07:02:49,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3bba034a798e8ebbcd952eeea7bc0671, ASSIGN in 577 msec 2023-02-08 07:02:49,838 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:02:49,839 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839769838"}]},"ts":"1675839769838"} 2023-02-08 07:02:49,841 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-08 07:02:49,844 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:02:49,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.2590 sec 2023-02-08 07:02:50,736 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:50,736 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:50,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:02:50,739 INFO [Listener at localhost/32917] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-08 07:02:50,739 DEBUG [Listener at localhost/32917] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-08 07:02:50,741 INFO [Listener at localhost/32917] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:02:50,751 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-08 07:02:50,752 INFO [Listener at localhost/32917] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:02:50,752 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-08 07:02:50,752 INFO [Listener at localhost/32917] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 07:02:50,918 DEBUG [hconnection-0x538229c-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:02:50,996 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59408, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:02:51,038 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41961] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:51,038 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35063] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:51,332 INFO [Listener at localhost/32917] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 07:02:51,336 INFO [Listener at localhost/32917] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 07:02:51,348 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:51,348 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:51,351 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 07:02:51,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675839771351 (current time:1675839771351). 2023-02-08 07:02:51,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 07:02:51,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] zookeeper.ReadOnlyZKClient(139): Connect 0x4e9ebf7f to 127.0.0.1:54762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:02:51,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46a4054, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:02:51,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:02:51,370 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48246, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:02:51,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e9ebf7f to 127.0.0.1:54762 2023-02-08 07:02:51,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:02:51,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 07:02:51,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 07:02:51,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 07:02:51,408 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 07:02:51,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 07:02:51,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-08 07:02:51,412 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 07:02:51,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 07:02:51,415 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 07:02:51,416 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 07:02:51,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 16 msec 2023-02-08 07:02:51,418 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 07:02:51,419 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675840371419 2023-02-08 07:02:51,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-08 07:02:51,448 INFO [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-08 07:02:51,448 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:02:51,449 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-08 07:02:51,449 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-08 07:02:51,449 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:51,449 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 07:02:51,452 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:02:51,452 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:51,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:02:51,452 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:02:51,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:02:51,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:02:51,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:02:51,452 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:51,452 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:51,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 07:02:51,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 07:02:51,453 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:51,453 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:02:51,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:51,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:51,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-08 07:02:51,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 07:02:51,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-08 07:02:51,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-08 07:02:51,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 07:02:51,456 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-08 07:02:51,457 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-08 07:02:51,457 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-08 07:02:51,460 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-08 07:02:51,460 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-08 07:02:51,460 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:02:51,460 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:02:51,461 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-08 07:02:51,461 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-08 07:02:51,461 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-08 07:02:51,461 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-08 07:02:51,461 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35063,1675839765615' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-08 07:02:51,461 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41961,1675839765567' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-08 07:02:51,464 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:51,464 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:51,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:51,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:02:51,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:02:51,464 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:51,465 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:51,465 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:02:51,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:02:51,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:02:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 07:02:51,466 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:51,466 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:51,466 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:02:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:02:51,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41961,1675839765567' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-08 07:02:51,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ce7ece4[Count = 1] remaining members to acquire global barrier 2023-02-08 07:02:51,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:51,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:02:51,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:02:51,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:02:51,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:02:51,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 07:02:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:02:51,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35063,1675839765615' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-08 07:02:51,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ce7ece4[Count = 0] remaining members to acquire global barrier 2023-02-08 07:02:51,472 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-08 07:02:51,472 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:51,474 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:51,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:51,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:51,475 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-08 07:02:51,476 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:51,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:51,477 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-08 07:02:51,477 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:51,478 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:51,478 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:51,478 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:02:51,479 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. started... 2023-02-08 07:02:51,485 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0ff96987c3f42b10504e567f52ec0b44 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:02:51,486 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:51,486 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-08 07:02:51,486 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. started... 2023-02-08 07:02:51,486 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:51,487 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:51,487 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. started... 2023-02-08 07:02:51,486 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 07:02:51,493 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:51,493 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d5df91c41ae95ce6206bc1458402cd2c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:02:51,493 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3bba034a798e8ebbcd952eeea7bc0671 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-08 07:02:51,487 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. started... 2023-02-08 07:02:51,493 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. started... 2023-02-08 07:02:51,496 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-08 07:02:51,496 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 07:02:51,496 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:51,496 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 63a9a028567d15ba686c122d4dc3a217 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-08 07:02:51,496 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. started... 2023-02-08 07:02:51,497 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e5f360121ad077c24ab1da4ed41793d1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:02:51,498 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 81797aa7b2c7e5c03d341ad6d4b22cfa: 2023-02-08 07:02:51,499 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:51,506 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:02:51,516 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:02:51,517 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:51,517 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:51,519 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 07:02:51,519 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 07:02:51,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 07:02:51,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:02:51,522 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 07:02:51,562 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. completed. 2023-02-08 07:02:51,562 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:51,564 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-08 07:02:51,564 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:51,564 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. started... 2023-02-08 07:02:51,564 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 87858cdb09f5de238cd652bb0c760c8f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:02:51,722 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:02:51,723 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:51,723 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:51,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 07:02:51,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:02:51,725 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-08 07:02:51,824 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/.tmp/f1/4f64d484f2af4203800d1e56fc7965bf 2023-02-08 07:02:51,834 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/.tmp/f1/0e095c4939624c7b9a2475f41cdc06c6 2023-02-08 07:02:51,839 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/.tmp/f1/c895724b473a4f1186d37af15f5f7c84 2023-02-08 07:02:51,840 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/.tmp/f1/622fd9c6fe5345e98ad6f6ff99f31a9a 2023-02-08 07:02:51,969 WARN [DataStreamer for file /user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/.tmp/f2/c7f3a9e9e1d944298c3ba19393f01641] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-08 07:02:51,969 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/.tmp/f2/c7f3a9e9e1d944298c3ba19393f01641 2023-02-08 07:02:51,980 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/.tmp/f2/c8f6403345c44c5bb590aa834c2bee3a 2023-02-08 07:02:51,983 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/.tmp/f1/0e095c4939624c7b9a2475f41cdc06c6 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1/0e095c4939624c7b9a2475f41cdc06c6 2023-02-08 07:02:51,991 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/.tmp/f1/622fd9c6fe5345e98ad6f6ff99f31a9a as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1/622fd9c6fe5345e98ad6f6ff99f31a9a 2023-02-08 07:02:51,994 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1/0e095c4939624c7b9a2475f41cdc06c6, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 07:02:51,996 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/.tmp/f2/c7f3a9e9e1d944298c3ba19393f01641 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2/c7f3a9e9e1d944298c3ba19393f01641 2023-02-08 07:02:52,001 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1/622fd9c6fe5345e98ad6f6ff99f31a9a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:02:52,004 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/.tmp/f2/c8f6403345c44c5bb590aa834c2bee3a as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2/c8f6403345c44c5bb590aa834c2bee3a 2023-02-08 07:02:52,007 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2/c7f3a9e9e1d944298c3ba19393f01641, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 07:02:52,009 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 63a9a028567d15ba686c122d4dc3a217 in 512ms, sequenceid=5, compaction requested=false 2023-02-08 07:02:52,011 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-08 07:02:52,013 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 63a9a028567d15ba686c122d4dc3a217: 2023-02-08 07:02:52,013 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,014 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:02:52,015 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1/0e095c4939624c7b9a2475f41cdc06c6] hfiles 2023-02-08 07:02:52,015 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1/0e095c4939624c7b9a2475f41cdc06c6 for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,015 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2/c8f6403345c44c5bb590aa834c2bee3a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:02:52,016 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 87858cdb09f5de238cd652bb0c760c8f in 452ms, sequenceid=5, compaction requested=false 2023-02-08 07:02:52,017 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 87858cdb09f5de238cd652bb0c760c8f: 2023-02-08 07:02:52,017 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,017 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:02:52,017 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1/622fd9c6fe5345e98ad6f6ff99f31a9a] hfiles 2023-02-08 07:02:52,017 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1/622fd9c6fe5345e98ad6f6ff99f31a9a for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,021 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2/c8f6403345c44c5bb590aa834c2bee3a] hfiles 2023-02-08 07:02:52,021 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2/c7f3a9e9e1d944298c3ba19393f01641] hfiles 2023-02-08 07:02:52,021 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2/c8f6403345c44c5bb590aa834c2bee3a for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,021 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2/c7f3a9e9e1d944298c3ba19393f01641 for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,026 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:02:52,026 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:52,026 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:52,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 07:02:52,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:02:52,030 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-08 07:02:52,044 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. completed. 2023-02-08 07:02:52,045 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:52,045 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:52,045 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-08 07:02:52,045 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. started... 2023-02-08 07:02:52,046 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 00061a9a43bd799484ccc17c89947e50 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:02:52,047 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. completed. 2023-02-08 07:02:52,047 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:52,047 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:52,047 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-08 07:02:52,047 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. started... 2023-02-08 07:02:52,048 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HRegion(2744): Flushing cf462321411027fc65d6e0abc079dbba 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:02:52,071 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/.tmp/f1/63f3533efdc34cf7b788f6aed639806e 2023-02-08 07:02:52,073 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/.tmp/f1/e9d2b3b997794c079d6505bf63f37f13 2023-02-08 07:02:52,107 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/.tmp/f2/812a15f0a24b4caf9301afee7d4b0ed4 2023-02-08 07:02:52,119 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/.tmp/f1/e9d2b3b997794c079d6505bf63f37f13 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1/e9d2b3b997794c079d6505bf63f37f13 2023-02-08 07:02:52,121 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/.tmp/f2/2ca47789699e4b7ab856cf3b066dae7a 2023-02-08 07:02:52,145 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1/e9d2b3b997794c079d6505bf63f37f13, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:02:52,146 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/.tmp/f2/812a15f0a24b4caf9301afee7d4b0ed4 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2/812a15f0a24b4caf9301afee7d4b0ed4 2023-02-08 07:02:52,146 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/.tmp/f1/63f3533efdc34cf7b788f6aed639806e as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1/63f3533efdc34cf7b788f6aed639806e 2023-02-08 07:02:52,157 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1/63f3533efdc34cf7b788f6aed639806e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:02:52,159 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/.tmp/f2/2ca47789699e4b7ab856cf3b066dae7a as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2/2ca47789699e4b7ab856cf3b066dae7a 2023-02-08 07:02:52,160 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2/812a15f0a24b4caf9301afee7d4b0ed4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:02:52,163 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cf462321411027fc65d6e0abc079dbba in 115ms, sequenceid=5, compaction requested=false 2023-02-08 07:02:52,163 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for cf462321411027fc65d6e0abc079dbba: 2023-02-08 07:02:52,163 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,163 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:02:52,163 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1/e9d2b3b997794c079d6505bf63f37f13] hfiles 2023-02-08 07:02:52,163 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1/e9d2b3b997794c079d6505bf63f37f13 for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,163 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2/812a15f0a24b4caf9301afee7d4b0ed4] hfiles 2023-02-08 07:02:52,164 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2/812a15f0a24b4caf9301afee7d4b0ed4 for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,170 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2/2ca47789699e4b7ab856cf3b066dae7a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:02:52,171 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 00061a9a43bd799484ccc17c89947e50 in 126ms, sequenceid=5, compaction requested=false 2023-02-08 07:02:52,171 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 00061a9a43bd799484ccc17c89947e50: 2023-02-08 07:02:52,171 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,171 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:02:52,171 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1/63f3533efdc34cf7b788f6aed639806e] hfiles 2023-02-08 07:02:52,171 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1/63f3533efdc34cf7b788f6aed639806e for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,172 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2/2ca47789699e4b7ab856cf3b066dae7a] hfiles 2023-02-08 07:02:52,172 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2/2ca47789699e4b7ab856cf3b066dae7a for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,182 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. completed. 2023-02-08 07:02:52,182 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:52,182 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:52,182 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-08 07:02:52,182 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. started... 2023-02-08 07:02:52,183 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ccb06f81840bf3b7fd0ca95472b51e8d: 2023-02-08 07:02:52,183 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,184 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:02:52,184 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 07:02:52,184 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 07:02:52,191 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. completed. 2023-02-08 07:02:52,191 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-08 07:02:52,196 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. completed. 2023-02-08 07:02:52,196 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:52,196 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-08 07:02:52,235 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/.tmp/f1/fede7e8a79714309b0fd638db59f4d56 2023-02-08 07:02:52,235 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/.tmp/f1/03de7e811efc48d9bcb558cd8ad0f22e 2023-02-08 07:02:52,284 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/.tmp/f2/dcbd4660ef5b4bd1a43eec837dd6cf3f 2023-02-08 07:02:52,298 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/.tmp/f1/03de7e811efc48d9bcb558cd8ad0f22e as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1/03de7e811efc48d9bcb558cd8ad0f22e 2023-02-08 07:02:52,309 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1/03de7e811efc48d9bcb558cd8ad0f22e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:02:52,311 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/.tmp/f2/dcbd4660ef5b4bd1a43eec837dd6cf3f as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2/dcbd4660ef5b4bd1a43eec837dd6cf3f 2023-02-08 07:02:52,323 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2/dcbd4660ef5b4bd1a43eec837dd6cf3f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:02:52,326 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0ff96987c3f42b10504e567f52ec0b44 in 842ms, sequenceid=5, compaction requested=false 2023-02-08 07:02:52,326 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0ff96987c3f42b10504e567f52ec0b44: 2023-02-08 07:02:52,326 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,326 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:02:52,326 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1/03de7e811efc48d9bcb558cd8ad0f22e] hfiles 2023-02-08 07:02:52,326 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1/03de7e811efc48d9bcb558cd8ad0f22e for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,327 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2/dcbd4660ef5b4bd1a43eec837dd6cf3f] hfiles 2023-02-08 07:02:52,327 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2/dcbd4660ef5b4bd1a43eec837dd6cf3f for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,345 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/.tmp/f2/017536cbf4374bdda41aa156258b0b2f 2023-02-08 07:02:52,371 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/.tmp/f2/38ec24f080e94dfb9ec1ffad694ce691 2023-02-08 07:02:52,372 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/.tmp/f2/86e01e61208f4200aa229b5c3b106cfc 2023-02-08 07:02:52,387 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/.tmp/f1/fede7e8a79714309b0fd638db59f4d56 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1/fede7e8a79714309b0fd638db59f4d56 2023-02-08 07:02:52,390 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. completed. 2023-02-08 07:02:52,390 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:52,391 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-08 07:02:52,397 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/.tmp/f1/4f64d484f2af4203800d1e56fc7965bf as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1/4f64d484f2af4203800d1e56fc7965bf 2023-02-08 07:02:52,397 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/.tmp/f1/c895724b473a4f1186d37af15f5f7c84 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1/c895724b473a4f1186d37af15f5f7c84 2023-02-08 07:02:52,401 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1/fede7e8a79714309b0fd638db59f4d56, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:02:52,403 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/.tmp/f2/017536cbf4374bdda41aa156258b0b2f as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2/017536cbf4374bdda41aa156258b0b2f 2023-02-08 07:02:52,407 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1/4f64d484f2af4203800d1e56fc7965bf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:02:52,408 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/.tmp/f2/86e01e61208f4200aa229b5c3b106cfc as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2/86e01e61208f4200aa229b5c3b106cfc 2023-02-08 07:02:52,410 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1/c895724b473a4f1186d37af15f5f7c84, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 07:02:52,411 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/.tmp/f2/38ec24f080e94dfb9ec1ffad694ce691 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2/38ec24f080e94dfb9ec1ffad694ce691 2023-02-08 07:02:52,413 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2/017536cbf4374bdda41aa156258b0b2f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:02:52,414 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d5df91c41ae95ce6206bc1458402cd2c in 921ms, sequenceid=5, compaction requested=false 2023-02-08 07:02:52,414 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d5df91c41ae95ce6206bc1458402cd2c: 2023-02-08 07:02:52,415 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,415 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:02:52,415 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1/fede7e8a79714309b0fd638db59f4d56] hfiles 2023-02-08 07:02:52,415 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1/fede7e8a79714309b0fd638db59f4d56 for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,415 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2/017536cbf4374bdda41aa156258b0b2f] hfiles 2023-02-08 07:02:52,415 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2/017536cbf4374bdda41aa156258b0b2f for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,419 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2/86e01e61208f4200aa229b5c3b106cfc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:02:52,420 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e5f360121ad077c24ab1da4ed41793d1 in 923ms, sequenceid=5, compaction requested=false 2023-02-08 07:02:52,420 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e5f360121ad077c24ab1da4ed41793d1: 2023-02-08 07:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1/4f64d484f2af4203800d1e56fc7965bf] hfiles 2023-02-08 07:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1/4f64d484f2af4203800d1e56fc7965bf for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2/86e01e61208f4200aa229b5c3b106cfc] hfiles 2023-02-08 07:02:52,421 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2/86e01e61208f4200aa229b5c3b106cfc for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,431 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2/38ec24f080e94dfb9ec1ffad694ce691, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 07:02:52,432 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 3bba034a798e8ebbcd952eeea7bc0671 in 940ms, sequenceid=5, compaction requested=false 2023-02-08 07:02:52,433 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3bba034a798e8ebbcd952eeea7bc0671: 2023-02-08 07:02:52,433 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,433 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:02:52,433 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1/c895724b473a4f1186d37af15f5f7c84] hfiles 2023-02-08 07:02:52,433 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1/c895724b473a4f1186d37af15f5f7c84 for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,433 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2/38ec24f080e94dfb9ec1ffad694ce691] hfiles 2023-02-08 07:02:52,433 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2/38ec24f080e94dfb9ec1ffad694ce691 for snapshot=testWithMapReduceMultiRegion 2023-02-08 07:02:52,456 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. completed. 2023-02-08 07:02:52,456 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:52,457 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-08 07:02:52,457 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-08 07:02:52,457 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,466 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. completed. 2023-02-08 07:02:52,466 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:52,466 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-08 07:02:52,467 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-08 07:02:52,467 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,41961,1675839765567' in zk 2023-02-08 07:02:52,471 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:02:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:02:52,471 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-08 07:02:52,471 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:02:52,471 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-08 07:02:52,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:02:52,472 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. completed. 2023-02-08 07:02:52,473 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:52,473 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-08 07:02:52,473 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-08 07:02:52,473 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,473 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-08 07:02:52,473 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35063,1675839765615' in zk 2023-02-08 07:02:52,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:02:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 07:02:52,476 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,476 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-08 07:02:52,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,476 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:02:52,476 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-08 07:02:52,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:02:52,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 07:02:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,41961,1675839765567': 2023-02-08 07:02:52,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41961,1675839765567' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-08 07:02:52,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:02:52,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:02:52,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:02:52,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:02:52,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 07:02:52,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:02:52,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 07:02:52,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35063,1675839765615': 2023-02-08 07:02:52,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35063,1675839765615' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-08 07:02:52,483 INFO [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-08 07:02:52,483 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:02:52,483 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:02:52,483 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-08 07:02:52,483 INFO [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 07:02:52,486 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:52,486 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:52,486 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:52,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:52,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:52,486 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:02:52,486 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:02:52,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:52,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:02:52,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:02:52,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:52,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:52,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:02:52,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:02:52,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:02:52,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:02:52,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:52,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:02:52,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:52,488 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 07:02:52,489 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:02:52,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 07:02:52,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,491 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:02:52,492 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 07:02:52,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,508 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:02:52,508 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,508 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:02:52,509 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 07:02:52,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:02:52,509 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:02:52,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:02:52,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-08 07:02:52,509 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,509 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 07:02:52,509 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:52,509 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:52,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-08 07:02:52,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:02:52,509 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:02:52,509 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:02:52,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:02:52,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:02:52,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:02:52,509 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:52,510 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 07:02:52,511 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 07:02:52,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:02:52,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:02:52,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-08 07:02:52,530 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:02:52,530 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:52,530 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:52,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 07:02:52,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:02:52,532 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-08 07:02:52,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-08 07:02:52,643 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-08 07:02:52,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-08 07:02:52,643 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-08 07:02:52,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675839771410Consolidate snapshot: testWithMapReduceMultiRegion at 1675839772509 (+1099 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1675839772509Writing data manifest for testWithMapReduceMultiRegion at 1675839772536 (+27 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1675839772555 (+19 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1675839772643 (+88 ms) 2023-02-08 07:02:52,645 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 07:02:52,647 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2340 sec 2023-02-08 07:02:52,884 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 07:02:52,947 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-08 07:02:52,948 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-08 07:02:53,533 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:02:53,533 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:53,533 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:53,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 07:02:53,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 07:02:53,535 INFO [Listener at localhost/32917] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 07:02:53,536 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:53,536 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:53,547 INFO [Listener at localhost/32917] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 07:02:53,557 INFO [Listener at localhost/32917] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 07:02:53,619 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41961] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:53,624 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35063] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:53,741 INFO [Listener at localhost/32917] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 07:02:53,752 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:53,753 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:53,755 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 07:02:53,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-08 07:02:53,760 INFO [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-08 07:02:53,760 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:02:53,761 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-08 07:02:53,761 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-08 07:02:53,762 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:53,762 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:02:53,763 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:02:53,763 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:02:53,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:02:53,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:02:53,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:02:53,763 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:53,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:02:53,764 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:53,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:02:53,764 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:53,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:02:53,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:53,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:53,765 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:53,765 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:02:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:02:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:02:53,765 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-08 07:02:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:02:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:02:53,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-08 07:02:53,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-08 07:02:53,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-08 07:02:53,772 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-08 07:02:53,772 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:02:53,772 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-08 07:02:53,773 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:02:53,773 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-08 07:02:53,773 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-08 07:02:53,776 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:53,776 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. started... 2023-02-08 07:02:53,776 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:53,776 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0ff96987c3f42b10504e567f52ec0b44 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:02:53,776 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. started... 2023-02-08 07:02:53,776 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3bba034a798e8ebbcd952eeea7bc0671 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-08 07:02:53,777 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:53,777 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. started... 2023-02-08 07:02:53,777 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 63a9a028567d15ba686c122d4dc3a217 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-08 07:02:53,779 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-08 07:02:53,779 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:53,779 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 07:02:53,779 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. started... 2023-02-08 07:02:53,779 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d5df91c41ae95ce6206bc1458402cd2c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:02:53,780 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:53,780 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. started... 2023-02-08 07:02:53,780 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 81797aa7b2c7e5c03d341ad6d4b22cfa: 2023-02-08 07:02:53,780 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:53,784 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:53,786 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. started... 2023-02-08 07:02:53,786 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e5f360121ad077c24ab1da4ed41793d1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:02:53,785 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-08 07:02:53,786 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 07:02:53,785 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:53,786 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-08 07:02:53,786 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. started... 2023-02-08 07:02:53,787 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 87858cdb09f5de238cd652bb0c760c8f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:02:53,859 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/.tmp/f1/47ddf801886b4e8482eb891b8c27ae6f 2023-02-08 07:02:53,860 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/.tmp/f1/778de4eb4fa84338abaebf98e58c4381 2023-02-08 07:02:53,862 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/.tmp/f1/9287d5645dc04e1a9e1319da0606b612 2023-02-08 07:02:53,864 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/.tmp/f1/5073b11b7c6445c495061eeec5daa561 2023-02-08 07:02:53,864 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/.tmp/f1/38649e54d68d4686a59789d5d518a7be 2023-02-08 07:02:53,867 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/.tmp/f1/f62a71f31521448b9b7fa01dfb6c2bcb 2023-02-08 07:02:53,912 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/.tmp/f2/cafe5d841467437985f5726716e8cfa7 2023-02-08 07:02:53,921 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/.tmp/f1/778de4eb4fa84338abaebf98e58c4381 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1/778de4eb4fa84338abaebf98e58c4381 2023-02-08 07:02:53,930 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1/778de4eb4fa84338abaebf98e58c4381, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:02:53,931 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/.tmp/f2/cafe5d841467437985f5726716e8cfa7 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2/cafe5d841467437985f5726716e8cfa7 2023-02-08 07:02:53,939 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2/cafe5d841467437985f5726716e8cfa7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:02:53,940 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/.tmp/f2/60cd6f2d94ae4891aabdb9401120ee8f 2023-02-08 07:02:53,940 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/.tmp/f2/2d519f836dd6447aa75ca70fc3b634f2 2023-02-08 07:02:53,941 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0ff96987c3f42b10504e567f52ec0b44 in 165ms, sequenceid=9, compaction requested=false 2023-02-08 07:02:53,941 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0ff96987c3f42b10504e567f52ec0b44: 2023-02-08 07:02:53,942 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:53,944 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/.tmp/f2/5bc400f00c524a259c8a434a09051c15 2023-02-08 07:02:53,948 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:53,948 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. started... 2023-02-08 07:02:53,948 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-08 07:02:53,948 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf462321411027fc65d6e0abc079dbba 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:02:53,948 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/.tmp/f1/9287d5645dc04e1a9e1319da0606b612 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1/9287d5645dc04e1a9e1319da0606b612 2023-02-08 07:02:53,956 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/.tmp/f1/47ddf801886b4e8482eb891b8c27ae6f as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1/47ddf801886b4e8482eb891b8c27ae6f 2023-02-08 07:02:53,957 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1/9287d5645dc04e1a9e1319da0606b612, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 07:02:53,958 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/.tmp/f1/5073b11b7c6445c495061eeec5daa561 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1/5073b11b7c6445c495061eeec5daa561 2023-02-08 07:02:53,959 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/.tmp/f2/2d519f836dd6447aa75ca70fc3b634f2 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2/2d519f836dd6447aa75ca70fc3b634f2 2023-02-08 07:02:53,968 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1/47ddf801886b4e8482eb891b8c27ae6f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:02:53,969 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/.tmp/f2/60cd6f2d94ae4891aabdb9401120ee8f as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2/60cd6f2d94ae4891aabdb9401120ee8f 2023-02-08 07:02:53,970 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2/2d519f836dd6447aa75ca70fc3b634f2, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 07:02:53,971 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 63a9a028567d15ba686c122d4dc3a217 in 194ms, sequenceid=9, compaction requested=false 2023-02-08 07:02:53,972 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 63a9a028567d15ba686c122d4dc3a217: 2023-02-08 07:02:53,972 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:53,972 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:53,972 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. started... 2023-02-08 07:02:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-08 07:02:53,972 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ccb06f81840bf3b7fd0ca95472b51e8d: 2023-02-08 07:02:53,972 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-08 07:02:53,976 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/.tmp/f2/69a4ca55beea4e7888e7ae9fc6dc73b9 2023-02-08 07:02:53,979 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/.tmp/f2/ead8f61c43b94f258932d80a5e208b70 2023-02-08 07:02:53,982 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2/60cd6f2d94ae4891aabdb9401120ee8f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:02:53,983 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d5df91c41ae95ce6206bc1458402cd2c in 204ms, sequenceid=9, compaction requested=false 2023-02-08 07:02:53,983 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d5df91c41ae95ce6206bc1458402cd2c: 2023-02-08 07:02:53,984 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:53,984 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-08 07:02:53,985 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1/5073b11b7c6445c495061eeec5daa561, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:02:53,985 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/.tmp/f1/f62a71f31521448b9b7fa01dfb6c2bcb as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1/f62a71f31521448b9b7fa01dfb6c2bcb 2023-02-08 07:02:53,986 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/.tmp/f2/5bc400f00c524a259c8a434a09051c15 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2/5bc400f00c524a259c8a434a09051c15 2023-02-08 07:02:53,992 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2/5bc400f00c524a259c8a434a09051c15, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:02:53,993 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e5f360121ad077c24ab1da4ed41793d1 in 207ms, sequenceid=9, compaction requested=false 2023-02-08 07:02:53,993 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e5f360121ad077c24ab1da4ed41793d1: 2023-02-08 07:02:53,993 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:53,996 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:53,996 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-08 07:02:53,996 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. started... 2023-02-08 07:02:53,996 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 00061a9a43bd799484ccc17c89947e50 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:02:54,001 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/.tmp/f1/f15fc3cecca8415fa9558ff3a831212a 2023-02-08 07:02:54,003 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/.tmp/f1/38649e54d68d4686a59789d5d518a7be as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1/38649e54d68d4686a59789d5d518a7be 2023-02-08 07:02:54,007 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1/f62a71f31521448b9b7fa01dfb6c2bcb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:02:54,010 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/.tmp/f2/69a4ca55beea4e7888e7ae9fc6dc73b9 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2/69a4ca55beea4e7888e7ae9fc6dc73b9 2023-02-08 07:02:54,012 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1/38649e54d68d4686a59789d5d518a7be, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 07:02:54,014 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/.tmp/f2/ead8f61c43b94f258932d80a5e208b70 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2/ead8f61c43b94f258932d80a5e208b70 2023-02-08 07:02:54,019 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2/69a4ca55beea4e7888e7ae9fc6dc73b9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:02:54,020 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 87858cdb09f5de238cd652bb0c760c8f in 233ms, sequenceid=9, compaction requested=false 2023-02-08 07:02:54,021 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 87858cdb09f5de238cd652bb0c760c8f: 2023-02-08 07:02:54,021 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:54,021 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-08 07:02:54,026 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2/ead8f61c43b94f258932d80a5e208b70, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 07:02:54,027 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 3bba034a798e8ebbcd952eeea7bc0671 in 251ms, sequenceid=9, compaction requested=false 2023-02-08 07:02:54,027 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3bba034a798e8ebbcd952eeea7bc0671: 2023-02-08 07:02:54,027 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:54,027 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-08 07:02:54,029 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/.tmp/f1/de0e0297de0b4229824a87d6d452db88 2023-02-08 07:02:54,037 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/.tmp/f2/824ddbaaa4b2483bb840f7753dbea393 2023-02-08 07:02:54,045 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/.tmp/f1/f15fc3cecca8415fa9558ff3a831212a as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1/f15fc3cecca8415fa9558ff3a831212a 2023-02-08 07:02:54,048 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/.tmp/f2/62ef7883965a40678930930d20adf9db 2023-02-08 07:02:54,051 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1/f15fc3cecca8415fa9558ff3a831212a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:02:54,052 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/.tmp/f2/824ddbaaa4b2483bb840f7753dbea393 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2/824ddbaaa4b2483bb840f7753dbea393 2023-02-08 07:02:54,054 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/.tmp/f1/de0e0297de0b4229824a87d6d452db88 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1/de0e0297de0b4229824a87d6d452db88 2023-02-08 07:02:54,057 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2/824ddbaaa4b2483bb840f7753dbea393, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:02:54,059 INFO [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cf462321411027fc65d6e0abc079dbba in 111ms, sequenceid=9, compaction requested=false 2023-02-08 07:02:54,059 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf462321411027fc65d6e0abc079dbba: 2023-02-08 07:02:54,059 DEBUG [rs(jenkins-hbase4.apache.org,41961,1675839765567)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:54,059 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-08 07:02:54,059 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-08 07:02:54,059 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,059 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-08 07:02:54,059 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41961,1675839765567' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-08 07:02:54,061 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1/de0e0297de0b4229824a87d6d452db88, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:02:54,062 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/.tmp/f2/62ef7883965a40678930930d20adf9db as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2/62ef7883965a40678930930d20adf9db 2023-02-08 07:02:54,062 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,062 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:02:54,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:02:54,063 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:02:54,063 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:02:54,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:02:54,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:02:54,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:02:54,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41961,1675839765567' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-08 07:02:54,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59e56514[Count = 1] remaining members to acquire global barrier 2023-02-08 07:02:54,067 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2/62ef7883965a40678930930d20adf9db, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:02:54,068 INFO [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 00061a9a43bd799484ccc17c89947e50 in 72ms, sequenceid=9, compaction requested=false 2023-02-08 07:02:54,069 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 00061a9a43bd799484ccc17c89947e50: 2023-02-08 07:02:54,069 DEBUG [rs(jenkins-hbase4.apache.org,35063,1675839765615)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:54,069 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-08 07:02:54,069 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-08 07:02:54,069 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,069 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-08 07:02:54,069 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35063,1675839765615' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-08 07:02:54,071 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,071 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:02:54,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:02:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:02:54,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:02:54,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:02:54,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:02:54,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:02:54,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35063,1675839765615' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-08 07:02:54,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59e56514[Count = 0] remaining members to acquire global barrier 2023-02-08 07:02:54,074 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-08 07:02:54,074 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,076 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,076 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,077 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-08 07:02:54,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,077 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,077 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-08 07:02:54,077 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-08 07:02:54,077 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35063,1675839765615' in zk 2023-02-08 07:02:54,077 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-08 07:02:54,077 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41961,1675839765567' in zk 2023-02-08 07:02:54,077 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,077 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:02:54,079 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-08 07:02:54,080 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,080 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:02:54,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:02:54,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:02:54,080 DEBUG [member: 'jenkins-hbase4.apache.org,41961,1675839765567' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-08 07:02:54,081 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:02:54,081 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-08 07:02:54,081 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:02:54,081 DEBUG [member: 'jenkins-hbase4.apache.org,35063,1675839765615' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-08 07:02:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:02:54,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:02:54,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:02:54,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:02:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,41961,1675839765567': 2023-02-08 07:02:54,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41961,1675839765567' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-08 07:02:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:02:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:02:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:02:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:02:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:02:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:02:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:02:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35063,1675839765615': 2023-02-08 07:02:54,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35063,1675839765615' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-08 07:02:54,091 INFO [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-08 07:02:54,091 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:02:54,091 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:02:54,091 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-08 07:02:54,091 INFO [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 07:02:54,095 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:54,095 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:54,095 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:54,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:54,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:54,095 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:02:54,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:54,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:02:54,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:02:54,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:54,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:54,095 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:02:54,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:02:54,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:02:54,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:02:54,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:02:54,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:02:54,096 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:54,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:54,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:02:54,097 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:02:54,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:02:54,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,099 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:02:54,100 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:02:54,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,105 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,105 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:02:54,105 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:02:54,105 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:02:54,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:02:54,105 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:02:54,105 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:54,105 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:02:54,106 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:02:54,106 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:02:54,106 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:02:54,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:02:54,106 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-08 07:02:54,106 DEBUG [(jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:02:54,106 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 07:02:54,106 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:54,107 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:02:54,107 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:02:54,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:02:54,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:02:54,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:02:54,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:02:54,109 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-08 07:02:54,109 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 07:02:54,209 DEBUG [Listener at localhost/32917] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 07:02:54,210 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:54,210 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:54,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 07:02:54,318 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/hadoop-2745096023788883413.jar 2023-02-08 07:02:54,335 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675839771351 type: FLUSH version: 2 ttl: 0 2023-02-08 07:02:54,337 DEBUG [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce 2023-02-08 07:02:54,338 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(239): region to add: 0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:54,338 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(239): region to add: 3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:54,338 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(239): region to add: 63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:54,338 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(239): region to add: 81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:54,338 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(239): region to add: d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:54,338 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(239): region to add: e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:54,339 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(239): region to add: 87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:54,339 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(239): region to add: 00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:54,339 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(239): region to add: cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:54,339 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(239): region to add: ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:54,339 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(585): clone region=0ff96987c3f42b10504e567f52ec0b44 as 0ff96987c3f42b10504e567f52ec0b44 in snapshot testWithMapReduceMultiRegion 2023-02-08 07:02:54,339 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(585): clone region=3bba034a798e8ebbcd952eeea7bc0671 as 3bba034a798e8ebbcd952eeea7bc0671 in snapshot testWithMapReduceMultiRegion 2023-02-08 07:02:54,339 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(585): clone region=63a9a028567d15ba686c122d4dc3a217 as 63a9a028567d15ba686c122d4dc3a217 in snapshot testWithMapReduceMultiRegion 2023-02-08 07:02:54,340 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(585): clone region=81797aa7b2c7e5c03d341ad6d4b22cfa as 81797aa7b2c7e5c03d341ad6d4b22cfa in snapshot testWithMapReduceMultiRegion 2023-02-08 07:02:54,340 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(585): clone region=d5df91c41ae95ce6206bc1458402cd2c as d5df91c41ae95ce6206bc1458402cd2c in snapshot testWithMapReduceMultiRegion 2023-02-08 07:02:54,340 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(585): clone region=e5f360121ad077c24ab1da4ed41793d1 as e5f360121ad077c24ab1da4ed41793d1 in snapshot testWithMapReduceMultiRegion 2023-02-08 07:02:54,340 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(585): clone region=87858cdb09f5de238cd652bb0c760c8f as 87858cdb09f5de238cd652bb0c760c8f in snapshot testWithMapReduceMultiRegion 2023-02-08 07:02:54,340 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(585): clone region=00061a9a43bd799484ccc17c89947e50 as 00061a9a43bd799484ccc17c89947e50 in snapshot testWithMapReduceMultiRegion 2023-02-08 07:02:54,340 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(585): clone region=cf462321411027fc65d6e0abc079dbba as cf462321411027fc65d6e0abc079dbba in snapshot testWithMapReduceMultiRegion 2023-02-08 07:02:54,340 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(585): clone region=ccb06f81840bf3b7fd0ca95472b51e8d as ccb06f81840bf3b7fd0ca95472b51e8d in snapshot testWithMapReduceMultiRegion 2023-02-08 07:02:54,343 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3bba034a798e8ebbcd952eeea7bc0671, NAME => 'testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1 2023-02-08 07:02:54,344 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 63a9a028567d15ba686c122d4dc3a217, NAME => 'testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1 2023-02-08 07:02:54,344 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0ff96987c3f42b10504e567f52ec0b44, NAME => 'testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1 2023-02-08 07:02:54,344 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 81797aa7b2c7e5c03d341ad6d4b22cfa, NAME => 'testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1 2023-02-08 07:02:54,345 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => d5df91c41ae95ce6206bc1458402cd2c, NAME => 'testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1 2023-02-08 07:02:54,345 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => e5f360121ad077c24ab1da4ed41793d1, NAME => 'testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1 2023-02-08 07:02:54,345 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 87858cdb09f5de238cd652bb0c760c8f, NAME => 'testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1 2023-02-08 07:02:54,349 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 00061a9a43bd799484ccc17c89947e50, NAME => 'testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1 2023-02-08 07:02:54,385 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:54,385 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 03de7e811efc48d9bcb558cd8ad0f22e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,404 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:54,404 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0e095c4939624c7b9a2475f41cdc06c6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,412 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:54,412 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c895724b473a4f1186d37af15f5f7c84 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,424 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:54,424 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 81797aa7b2c7e5c03d341ad6d4b22cfa, disabling compactions & flushes 2023-02-08 07:02:54,424 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:54,424 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:54,424 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. after waiting 0 ms 2023-02-08 07:02:54,424 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:54,424 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:54,425 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 81797aa7b2c7e5c03d341ad6d4b22cfa: Waiting for close lock at 1675839774424Disabling compacts and flushes for region at 1675839774424Disabling writes for close at 1675839774424Writing region close event to WAL at 1675839774424Closed at 1675839774424 2023-02-08 07:02:54,425 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => cf462321411027fc65d6e0abc079dbba, NAME => 'testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1 2023-02-08 07:02:54,433 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:54,433 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 622fd9c6fe5345e98ad6f6ff99f31a9a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,440 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dcbd4660ef5b4bd1a43eec837dd6cf3f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,440 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:54,440 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4f64d484f2af4203800d1e56fc7965bf from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,447 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c7f3a9e9e1d944298c3ba19393f01641 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,454 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c8f6403345c44c5bb590aa834c2bee3a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,455 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 86e01e61208f4200aa229b5c3b106cfc from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,455 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 38ec24f080e94dfb9ec1ffad694ce691 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,469 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:54,469 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fede7e8a79714309b0fd638db59f4d56 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,470 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing e5f360121ad077c24ab1da4ed41793d1, disabling compactions & flushes 2023-02-08 07:02:54,470 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:54,471 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:54,471 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. after waiting 0 ms 2023-02-08 07:02:54,471 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:54,471 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:54,471 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for e5f360121ad077c24ab1da4ed41793d1: Waiting for close lock at 1675839774470Disabling compacts and flushes for region at 1675839774470Disabling writes for close at 1675839774471 (+1 ms)Writing region close event to WAL at 1675839774471Closed at 1675839774471 2023-02-08 07:02:54,471 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 63a9a028567d15ba686c122d4dc3a217, disabling compactions & flushes 2023-02-08 07:02:54,472 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => ccb06f81840bf3b7fd0ca95472b51e8d, NAME => 'testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1 2023-02-08 07:02:54,472 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:54,472 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:54,472 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. after waiting 0 ms 2023-02-08 07:02:54,473 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:54,473 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:54,473 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 63a9a028567d15ba686c122d4dc3a217: Waiting for close lock at 1675839774471Disabling compacts and flushes for region at 1675839774471Disabling writes for close at 1675839774473 (+2 ms)Writing region close event to WAL at 1675839774473Closed at 1675839774473 2023-02-08 07:02:54,473 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 87858cdb09f5de238cd652bb0c760c8f, disabling compactions & flushes 2023-02-08 07:02:54,473 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:54,473 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:54,474 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e9d2b3b997794c079d6505bf63f37f13 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,474 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 63f3533efdc34cf7b788f6aed639806e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,472 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0ff96987c3f42b10504e567f52ec0b44, disabling compactions & flushes 2023-02-08 07:02:54,472 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 3bba034a798e8ebbcd952eeea7bc0671, disabling compactions & flushes 2023-02-08 07:02:54,474 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:54,474 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:54,473 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:54,474 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:54,474 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:54,474 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:54,474 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. after waiting 0 ms 2023-02-08 07:02:54,474 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:54,475 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:54,474 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. after waiting 0 ms 2023-02-08 07:02:54,475 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:54,475 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:54,475 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0ff96987c3f42b10504e567f52ec0b44: Waiting for close lock at 1675839774472Disabling compacts and flushes for region at 1675839774472Disabling writes for close at 1675839774475 (+3 ms)Writing region close event to WAL at 1675839774475Closed at 1675839774475 2023-02-08 07:02:54,474 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. after waiting 0 ms 2023-02-08 07:02:54,475 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 3bba034a798e8ebbcd952eeea7bc0671: Waiting for close lock at 1675839774472Disabling compacts and flushes for region at 1675839774472Disabling writes for close at 1675839774474 (+2 ms)Writing region close event to WAL at 1675839774475 (+1 ms)Closed at 1675839774475 2023-02-08 07:02:54,475 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:54,475 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:54,475 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 87858cdb09f5de238cd652bb0c760c8f: Waiting for close lock at 1675839774473Disabling compacts and flushes for region at 1675839774473Disabling writes for close at 1675839774475 (+2 ms)Writing region close event to WAL at 1675839774475Closed at 1675839774475 2023-02-08 07:02:54,480 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 017536cbf4374bdda41aa156258b0b2f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,480 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2ca47789699e4b7ab856cf3b066dae7a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,482 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 812a15f0a24b4caf9301afee7d4b0ed4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 07:02:54,485 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 00061a9a43bd799484ccc17c89947e50, disabling compactions & flushes 2023-02-08 07:02:54,485 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:54,485 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:54,485 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. after waiting 0 ms 2023-02-08 07:02:54,485 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:54,485 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:54,485 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 00061a9a43bd799484ccc17c89947e50: Waiting for close lock at 1675839774485Disabling compacts and flushes for region at 1675839774485Disabling writes for close at 1675839774485Writing region close event to WAL at 1675839774485Closed at 1675839774485 2023-02-08 07:02:54,486 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing d5df91c41ae95ce6206bc1458402cd2c, disabling compactions & flushes 2023-02-08 07:02:54,486 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:54,486 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:54,486 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. after waiting 0 ms 2023-02-08 07:02:54,486 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:54,487 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:54,487 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for d5df91c41ae95ce6206bc1458402cd2c: Waiting for close lock at 1675839774486Disabling compacts and flushes for region at 1675839774486Disabling writes for close at 1675839774486Writing region close event to WAL at 1675839774487 (+1 ms)Closed at 1675839774487 2023-02-08 07:02:54,487 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing cf462321411027fc65d6e0abc079dbba, disabling compactions & flushes 2023-02-08 07:02:54,487 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:54,487 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:54,487 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. after waiting 0 ms 2023-02-08 07:02:54,487 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:54,487 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:54,487 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for cf462321411027fc65d6e0abc079dbba: Waiting for close lock at 1675839774487Disabling compacts and flushes for region at 1675839774487Disabling writes for close at 1675839774487Writing region close event to WAL at 1675839774487Closed at 1675839774487 2023-02-08 07:02:54,490 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:54,490 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing ccb06f81840bf3b7fd0ca95472b51e8d, disabling compactions & flushes 2023-02-08 07:02:54,490 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:54,490 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:54,490 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. after waiting 0 ms 2023-02-08 07:02:54,490 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:54,490 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:54,490 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for ccb06f81840bf3b7fd0ca95472b51e8d: Waiting for close lock at 1675839774490Disabling compacts and flushes for region at 1675839774490Disabling writes for close at 1675839774490Writing region close event to WAL at 1675839774490Closed at 1675839774490 2023-02-08 07:02:54,491 INFO [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675839771351 type: FLUSH version: 2 ttl: 0 2023-02-08 07:02:54,491 DEBUG [Listener at localhost/32917] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1 2023-02-08 07:02:54,491 DEBUG [Listener at localhost/32917] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1 2023-02-08 07:02:54,492 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-data/ 2023-02-08 07:02:54,493 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |----default/ 2023-02-08 07:02:54,493 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-08 07:02:54,494 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |----------00061a9a43bd799484ccc17c89947e50/ 2023-02-08 07:02:54,494 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:02:54,494 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:02:54,495 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=00061a9a43bd799484ccc17c89947e50-63f3533efdc34cf7b788f6aed639806e 2023-02-08 07:02:54,495 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:02:54,495 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=00061a9a43bd799484ccc17c89947e50-2ca47789699e4b7ab856cf3b066dae7a 2023-02-08 07:02:54,496 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |----------0ff96987c3f42b10504e567f52ec0b44/ 2023-02-08 07:02:54,496 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:02:54,496 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:02:54,497 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=0ff96987c3f42b10504e567f52ec0b44-03de7e811efc48d9bcb558cd8ad0f22e 2023-02-08 07:02:54,497 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:02:54,497 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=0ff96987c3f42b10504e567f52ec0b44-dcbd4660ef5b4bd1a43eec837dd6cf3f 2023-02-08 07:02:54,497 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |----------3bba034a798e8ebbcd952eeea7bc0671/ 2023-02-08 07:02:54,498 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:02:54,498 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:02:54,498 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=3bba034a798e8ebbcd952eeea7bc0671-c895724b473a4f1186d37af15f5f7c84 2023-02-08 07:02:54,498 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:02:54,499 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=3bba034a798e8ebbcd952eeea7bc0671-38ec24f080e94dfb9ec1ffad694ce691 2023-02-08 07:02:54,499 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |----------63a9a028567d15ba686c122d4dc3a217/ 2023-02-08 07:02:54,499 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:02:54,499 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:02:54,500 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=63a9a028567d15ba686c122d4dc3a217-0e095c4939624c7b9a2475f41cdc06c6 2023-02-08 07:02:54,500 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:02:54,500 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=63a9a028567d15ba686c122d4dc3a217-c7f3a9e9e1d944298c3ba19393f01641 2023-02-08 07:02:54,501 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |----------81797aa7b2c7e5c03d341ad6d4b22cfa/ 2023-02-08 07:02:54,501 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:02:54,501 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |----------87858cdb09f5de238cd652bb0c760c8f/ 2023-02-08 07:02:54,502 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:02:54,502 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:02:54,502 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=87858cdb09f5de238cd652bb0c760c8f-622fd9c6fe5345e98ad6f6ff99f31a9a 2023-02-08 07:02:54,502 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:02:54,503 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=87858cdb09f5de238cd652bb0c760c8f-c8f6403345c44c5bb590aa834c2bee3a 2023-02-08 07:02:54,503 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |----------ccb06f81840bf3b7fd0ca95472b51e8d/ 2023-02-08 07:02:54,503 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:02:54,503 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |----------cf462321411027fc65d6e0abc079dbba/ 2023-02-08 07:02:54,504 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:02:54,504 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:02:54,504 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=cf462321411027fc65d6e0abc079dbba-e9d2b3b997794c079d6505bf63f37f13 2023-02-08 07:02:54,504 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:02:54,505 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=cf462321411027fc65d6e0abc079dbba-812a15f0a24b4caf9301afee7d4b0ed4 2023-02-08 07:02:54,505 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |----------d5df91c41ae95ce6206bc1458402cd2c/ 2023-02-08 07:02:54,505 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:02:54,505 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:02:54,506 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=d5df91c41ae95ce6206bc1458402cd2c-fede7e8a79714309b0fd638db59f4d56 2023-02-08 07:02:54,506 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:02:54,506 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=d5df91c41ae95ce6206bc1458402cd2c-017536cbf4374bdda41aa156258b0b2f 2023-02-08 07:02:54,506 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |----------e5f360121ad077c24ab1da4ed41793d1/ 2023-02-08 07:02:54,507 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:02:54,507 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:02:54,508 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=e5f360121ad077c24ab1da4ed41793d1-4f64d484f2af4203800d1e56fc7965bf 2023-02-08 07:02:54,508 DEBUG [Listener at localhost/32917] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:02:54,508 DEBUG [Listener at localhost/32917] util.CommonFSUtils(702): |----------------testWithMapReduce=e5f360121ad077c24ab1da4ed41793d1-86e01e61208f4200aa229b5c3b106cfc 2023-02-08 07:02:54,516 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,516 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,517 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,517 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,517 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,518 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,518 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,546 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 07:02:54,547 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-08 07:02:54,590 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/hadoop-8751892727570173948.jar 2023-02-08 07:02:54,590 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,591 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,591 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,592 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,592 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,593 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,594 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-08 07:02:54,594 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-08 07:02:54,594 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-08 07:02:54,595 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-08 07:02:54,595 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-08 07:02:54,596 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-08 07:02:54,597 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-08 07:02:54,597 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-08 07:02:54,598 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-08 07:02:54,599 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-08 07:02:54,605 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-08 07:02:54,606 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 07:02:54,606 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 07:02:54,606 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 07:02:54,607 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-08 07:02:54,675 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/hadoop-8682264204218459011.jar 2023-02-08 07:02:54,676 DEBUG [Listener at localhost/32917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-08 07:02:54,727 WARN [Listener at localhost/32917] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-08 07:02:54,783 INFO [Listener at localhost/32917] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-08 07:02:55,151 WARN [Listener at localhost/32917] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/mapreduce.cluster.local.dir/1675839775071/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-08 07:02:55,152 WARN [Listener at localhost/32917] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/mapreduce.cluster.local.dir/1675839775071/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-08 07:02:55,304 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:55,304 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:02:55,306 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:02:55,308 INFO [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:55,309 DEBUG [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1 2023-02-08 07:02:55,309 INFO [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bba034a798e8ebbcd952eeea7bc0671 columnFamilyName f1 2023-02-08 07:02:55,317 DEBUG [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1/testWithMapReduce=3bba034a798e8ebbcd952eeea7bc0671-c895724b473a4f1186d37af15f5f7c84 2023-02-08 07:02:55,317 INFO [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] regionserver.HStore(310): Store=3bba034a798e8ebbcd952eeea7bc0671/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:55,317 INFO [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:55,318 DEBUG [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2 2023-02-08 07:02:55,319 INFO [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bba034a798e8ebbcd952eeea7bc0671 columnFamilyName f2 2023-02-08 07:02:55,324 DEBUG [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2/testWithMapReduce=3bba034a798e8ebbcd952eeea7bc0671-38ec24f080e94dfb9ec1ffad694ce691 2023-02-08 07:02:55,324 INFO [StoreOpener-3bba034a798e8ebbcd952eeea7bc0671-1] regionserver.HStore(310): Store=3bba034a798e8ebbcd952eeea7bc0671/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:55,324 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:55,324 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3bba034a798e8ebbcd952eeea7bc0671; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71302492, jitterRate=0.06248992681503296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:55,324 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3bba034a798e8ebbcd952eeea7bc0671: Writing region info on filesystem at 1675839775306Initializing all the Stores at 1675839775307 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839775307Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839775307Region opened successfully at 1675839775324 (+17 ms) 2023-02-08 07:02:55,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3bba034a798e8ebbcd952eeea7bc0671, disabling compactions & flushes 2023-02-08 07:02:55,488 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:55,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:55,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. after waiting 0 ms 2023-02-08 07:02:55,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:55,492 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:55,493 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3bba034a798e8ebbcd952eeea7bc0671: Waiting for close lock at 1675839775488Disabling compacts and flushes for region at 1675839775488Disabling writes for close at 1675839775488Writing region close event to WAL at 1675839775492 (+4 ms)Closed at 1675839775492 2023-02-08 07:02:55,510 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:55,510 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:02:55,512 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:02:55,515 INFO [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:55,516 DEBUG [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1 2023-02-08 07:02:55,517 INFO [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00061a9a43bd799484ccc17c89947e50 columnFamilyName f1 2023-02-08 07:02:55,524 DEBUG [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1/testWithMapReduce=00061a9a43bd799484ccc17c89947e50-63f3533efdc34cf7b788f6aed639806e 2023-02-08 07:02:55,524 INFO [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] regionserver.HStore(310): Store=00061a9a43bd799484ccc17c89947e50/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:55,524 INFO [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:55,525 DEBUG [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2 2023-02-08 07:02:55,526 INFO [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00061a9a43bd799484ccc17c89947e50 columnFamilyName f2 2023-02-08 07:02:55,533 DEBUG [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2/testWithMapReduce=00061a9a43bd799484ccc17c89947e50-2ca47789699e4b7ab856cf3b066dae7a 2023-02-08 07:02:55,533 INFO [StoreOpener-00061a9a43bd799484ccc17c89947e50-1] regionserver.HStore(310): Store=00061a9a43bd799484ccc17c89947e50/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:55,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:55,534 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 00061a9a43bd799484ccc17c89947e50; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60446334, jitterRate=-0.09927943348884583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:55,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 00061a9a43bd799484ccc17c89947e50: Writing region info on filesystem at 1675839775512Initializing all the Stores at 1675839775513 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839775513Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839775514 (+1 ms)Region opened successfully at 1675839775534 (+20 ms) 2023-02-08 07:02:55,589 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 00061a9a43bd799484ccc17c89947e50, disabling compactions & flushes 2023-02-08 07:02:55,589 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:55,589 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:55,589 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. after waiting 0 ms 2023-02-08 07:02:55,589 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:55,595 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:55,595 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 00061a9a43bd799484ccc17c89947e50: Waiting for close lock at 1675839775589Disabling compacts and flushes for region at 1675839775589Disabling writes for close at 1675839775589Writing region close event to WAL at 1675839775595 (+6 ms)Closed at 1675839775595 2023-02-08 07:02:55,606 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:55,606 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:02:55,612 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:02:55,617 INFO [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:55,618 DEBUG [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1 2023-02-08 07:02:55,618 INFO [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87858cdb09f5de238cd652bb0c760c8f columnFamilyName f1 2023-02-08 07:02:55,626 DEBUG [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1/testWithMapReduce=87858cdb09f5de238cd652bb0c760c8f-622fd9c6fe5345e98ad6f6ff99f31a9a 2023-02-08 07:02:55,626 INFO [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] regionserver.HStore(310): Store=87858cdb09f5de238cd652bb0c760c8f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:55,626 INFO [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:55,628 DEBUG [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2 2023-02-08 07:02:55,628 INFO [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87858cdb09f5de238cd652bb0c760c8f columnFamilyName f2 2023-02-08 07:02:55,642 DEBUG [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2/testWithMapReduce=87858cdb09f5de238cd652bb0c760c8f-c8f6403345c44c5bb590aa834c2bee3a 2023-02-08 07:02:55,643 INFO [StoreOpener-87858cdb09f5de238cd652bb0c760c8f-1] regionserver.HStore(310): Store=87858cdb09f5de238cd652bb0c760c8f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:55,643 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:55,643 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 87858cdb09f5de238cd652bb0c760c8f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73338353, jitterRate=0.09282661974430084}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:55,643 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 87858cdb09f5de238cd652bb0c760c8f: Writing region info on filesystem at 1675839775612Initializing all the Stores at 1675839775613 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839775613Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839775616 (+3 ms)Region opened successfully at 1675839775643 (+27 ms) 2023-02-08 07:02:55,694 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 87858cdb09f5de238cd652bb0c760c8f, disabling compactions & flushes 2023-02-08 07:02:55,695 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:55,695 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:55,695 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. after waiting 0 ms 2023-02-08 07:02:55,695 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:55,703 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:55,703 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 87858cdb09f5de238cd652bb0c760c8f: Waiting for close lock at 1675839775694Disabling compacts and flushes for region at 1675839775694Disabling writes for close at 1675839775695 (+1 ms)Writing region close event to WAL at 1675839775703 (+8 ms)Closed at 1675839775703 2023-02-08 07:02:55,709 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:55,710 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:02:55,711 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:02:55,716 INFO [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:55,718 DEBUG [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1 2023-02-08 07:02:55,718 INFO [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ff96987c3f42b10504e567f52ec0b44 columnFamilyName f1 2023-02-08 07:02:55,738 DEBUG [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1/testWithMapReduce=0ff96987c3f42b10504e567f52ec0b44-03de7e811efc48d9bcb558cd8ad0f22e 2023-02-08 07:02:55,739 INFO [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] regionserver.HStore(310): Store=0ff96987c3f42b10504e567f52ec0b44/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:55,739 INFO [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:55,740 DEBUG [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2 2023-02-08 07:02:55,741 INFO [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ff96987c3f42b10504e567f52ec0b44 columnFamilyName f2 2023-02-08 07:02:55,754 DEBUG [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2/testWithMapReduce=0ff96987c3f42b10504e567f52ec0b44-dcbd4660ef5b4bd1a43eec837dd6cf3f 2023-02-08 07:02:55,754 INFO [StoreOpener-0ff96987c3f42b10504e567f52ec0b44-1] regionserver.HStore(310): Store=0ff96987c3f42b10504e567f52ec0b44/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:55,754 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:55,755 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0ff96987c3f42b10504e567f52ec0b44; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70340792, jitterRate=0.04815948009490967}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:55,755 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0ff96987c3f42b10504e567f52ec0b44: Writing region info on filesystem at 1675839775711Initializing all the Stores at 1675839775712 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839775712Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839775716 (+4 ms)Region opened successfully at 1675839775755 (+39 ms) 2023-02-08 07:02:55,825 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0ff96987c3f42b10504e567f52ec0b44, disabling compactions & flushes 2023-02-08 07:02:55,825 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:55,825 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:55,826 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. after waiting 0 ms 2023-02-08 07:02:55,826 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:55,829 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:55,829 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0ff96987c3f42b10504e567f52ec0b44: Waiting for close lock at 1675839775825Disabling compacts and flushes for region at 1675839775825Disabling writes for close at 1675839775826 (+1 ms)Writing region close event to WAL at 1675839775829 (+3 ms)Closed at 1675839775829 2023-02-08 07:02:55,834 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:55,834 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:02:55,843 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:02:55,846 INFO [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:55,848 DEBUG [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1 2023-02-08 07:02:55,849 INFO [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63a9a028567d15ba686c122d4dc3a217 columnFamilyName f1 2023-02-08 07:02:55,863 DEBUG [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1/testWithMapReduce=63a9a028567d15ba686c122d4dc3a217-0e095c4939624c7b9a2475f41cdc06c6 2023-02-08 07:02:55,864 INFO [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] regionserver.HStore(310): Store=63a9a028567d15ba686c122d4dc3a217/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:55,864 INFO [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:55,868 DEBUG [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2 2023-02-08 07:02:55,868 INFO [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63a9a028567d15ba686c122d4dc3a217 columnFamilyName f2 2023-02-08 07:02:55,881 DEBUG [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2/testWithMapReduce=63a9a028567d15ba686c122d4dc3a217-c7f3a9e9e1d944298c3ba19393f01641 2023-02-08 07:02:55,881 INFO [StoreOpener-63a9a028567d15ba686c122d4dc3a217-1] regionserver.HStore(310): Store=63a9a028567d15ba686c122d4dc3a217/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:55,881 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:55,881 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 63a9a028567d15ba686c122d4dc3a217; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61244078, jitterRate=-0.08739212155342102}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:55,881 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 63a9a028567d15ba686c122d4dc3a217: Writing region info on filesystem at 1675839775844Initializing all the Stores at 1675839775845 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839775845Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839775845Region opened successfully at 1675839775881 (+36 ms) 2023-02-08 07:02:55,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 63a9a028567d15ba686c122d4dc3a217, disabling compactions & flushes 2023-02-08 07:02:55,921 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:55,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:55,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. after waiting 0 ms 2023-02-08 07:02:55,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:55,926 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:55,926 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 63a9a028567d15ba686c122d4dc3a217: Waiting for close lock at 1675839775921Disabling compacts and flushes for region at 1675839775921Disabling writes for close at 1675839775921Writing region close event to WAL at 1675839775926 (+5 ms)Closed at 1675839775926 2023-02-08 07:02:55,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:55,933 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:02:55,975 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:02:55,978 INFO [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:55,980 DEBUG [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/f1 2023-02-08 07:02:55,980 INFO [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81797aa7b2c7e5c03d341ad6d4b22cfa columnFamilyName f1 2023-02-08 07:02:55,981 INFO [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] regionserver.HStore(310): Store=81797aa7b2c7e5c03d341ad6d4b22cfa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:55,981 INFO [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:55,983 DEBUG [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/f2 2023-02-08 07:02:55,983 INFO [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81797aa7b2c7e5c03d341ad6d4b22cfa columnFamilyName f2 2023-02-08 07:02:55,986 INFO [StoreOpener-81797aa7b2c7e5c03d341ad6d4b22cfa-1] regionserver.HStore(310): Store=81797aa7b2c7e5c03d341ad6d4b22cfa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:55,987 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:55,987 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 81797aa7b2c7e5c03d341ad6d4b22cfa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62440741, jitterRate=-0.0695604532957077}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:55,987 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 81797aa7b2c7e5c03d341ad6d4b22cfa: Writing region info on filesystem at 1675839775975Initializing all the Stores at 1675839775976 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839775977 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839775977Region opened successfully at 1675839775987 (+10 ms) 2023-02-08 07:02:56,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 81797aa7b2c7e5c03d341ad6d4b22cfa, disabling compactions & flushes 2023-02-08 07:02:56,005 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:56,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:56,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. after waiting 0 ms 2023-02-08 07:02:56,006 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:56,006 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:56,006 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 81797aa7b2c7e5c03d341ad6d4b22cfa: Waiting for close lock at 1675839776005Disabling compacts and flushes for region at 1675839776005Disabling writes for close at 1675839776006 (+1 ms)Writing region close event to WAL at 1675839776006Closed at 1675839776006 2023-02-08 07:02:56,012 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:56,012 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:02:56,013 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:02:56,015 INFO [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:56,017 DEBUG [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/f1 2023-02-08 07:02:56,018 INFO [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ccb06f81840bf3b7fd0ca95472b51e8d columnFamilyName f1 2023-02-08 07:02:56,019 INFO [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] regionserver.HStore(310): Store=ccb06f81840bf3b7fd0ca95472b51e8d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:56,019 INFO [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:56,021 DEBUG [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/f2 2023-02-08 07:02:56,021 INFO [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ccb06f81840bf3b7fd0ca95472b51e8d columnFamilyName f2 2023-02-08 07:02:56,022 INFO [StoreOpener-ccb06f81840bf3b7fd0ca95472b51e8d-1] regionserver.HStore(310): Store=ccb06f81840bf3b7fd0ca95472b51e8d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:56,022 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:56,022 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ccb06f81840bf3b7fd0ca95472b51e8d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71948146, jitterRate=0.07211092114448547}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:56,022 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ccb06f81840bf3b7fd0ca95472b51e8d: Writing region info on filesystem at 1675839776014Initializing all the Stores at 1675839776015 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839776015Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839776015Region opened successfully at 1675839776022 (+7 ms) 2023-02-08 07:02:56,045 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ccb06f81840bf3b7fd0ca95472b51e8d, disabling compactions & flushes 2023-02-08 07:02:56,045 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:56,045 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:56,045 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. after waiting 0 ms 2023-02-08 07:02:56,045 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:56,045 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:56,045 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ccb06f81840bf3b7fd0ca95472b51e8d: Waiting for close lock at 1675839776045Disabling compacts and flushes for region at 1675839776045Disabling writes for close at 1675839776045Writing region close event to WAL at 1675839776045Closed at 1675839776045 2023-02-08 07:02:56,056 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:56,056 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:02:56,058 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:02:56,060 INFO [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:56,062 DEBUG [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1 2023-02-08 07:02:56,062 INFO [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5df91c41ae95ce6206bc1458402cd2c columnFamilyName f1 2023-02-08 07:02:56,071 DEBUG [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1/testWithMapReduce=d5df91c41ae95ce6206bc1458402cd2c-fede7e8a79714309b0fd638db59f4d56 2023-02-08 07:02:56,071 INFO [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] regionserver.HStore(310): Store=d5df91c41ae95ce6206bc1458402cd2c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:56,072 INFO [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:56,073 DEBUG [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2 2023-02-08 07:02:56,073 INFO [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5df91c41ae95ce6206bc1458402cd2c columnFamilyName f2 2023-02-08 07:02:56,079 DEBUG [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2/testWithMapReduce=d5df91c41ae95ce6206bc1458402cd2c-017536cbf4374bdda41aa156258b0b2f 2023-02-08 07:02:56,079 INFO [StoreOpener-d5df91c41ae95ce6206bc1458402cd2c-1] regionserver.HStore(310): Store=d5df91c41ae95ce6206bc1458402cd2c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:56,079 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:56,079 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d5df91c41ae95ce6206bc1458402cd2c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59537633, jitterRate=-0.11282013356685638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:56,079 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d5df91c41ae95ce6206bc1458402cd2c: Writing region info on filesystem at 1675839776058Initializing all the Stores at 1675839776059 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839776059Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839776060 (+1 ms)Region opened successfully at 1675839776079 (+19 ms) 2023-02-08 07:02:56,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d5df91c41ae95ce6206bc1458402cd2c, disabling compactions & flushes 2023-02-08 07:02:56,129 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:56,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:56,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. after waiting 0 ms 2023-02-08 07:02:56,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:56,135 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:56,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d5df91c41ae95ce6206bc1458402cd2c: Waiting for close lock at 1675839776129Disabling compacts and flushes for region at 1675839776129Disabling writes for close at 1675839776129Writing region close event to WAL at 1675839776135 (+6 ms)Closed at 1675839776135 2023-02-08 07:02:56,139 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:56,139 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:02:56,146 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:02:56,153 INFO [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:56,154 DEBUG [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1 2023-02-08 07:02:56,155 INFO [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf462321411027fc65d6e0abc079dbba columnFamilyName f1 2023-02-08 07:02:56,164 DEBUG [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1/testWithMapReduce=cf462321411027fc65d6e0abc079dbba-e9d2b3b997794c079d6505bf63f37f13 2023-02-08 07:02:56,164 INFO [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] regionserver.HStore(310): Store=cf462321411027fc65d6e0abc079dbba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:56,164 INFO [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:56,165 DEBUG [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2 2023-02-08 07:02:56,166 INFO [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf462321411027fc65d6e0abc079dbba columnFamilyName f2 2023-02-08 07:02:56,174 DEBUG [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2/testWithMapReduce=cf462321411027fc65d6e0abc079dbba-812a15f0a24b4caf9301afee7d4b0ed4 2023-02-08 07:02:56,174 INFO [StoreOpener-cf462321411027fc65d6e0abc079dbba-1] regionserver.HStore(310): Store=cf462321411027fc65d6e0abc079dbba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:56,174 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:56,174 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cf462321411027fc65d6e0abc079dbba; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68813238, jitterRate=0.025397151708602905}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:56,174 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cf462321411027fc65d6e0abc079dbba: Writing region info on filesystem at 1675839776147Initializing all the Stores at 1675839776148 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839776148Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839776153 (+5 ms)Region opened successfully at 1675839776174 (+21 ms) 2023-02-08 07:02:56,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cf462321411027fc65d6e0abc079dbba, disabling compactions & flushes 2023-02-08 07:02:56,218 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:56,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:56,219 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. after waiting 1 ms 2023-02-08 07:02:56,219 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:56,227 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:56,227 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cf462321411027fc65d6e0abc079dbba: Waiting for close lock at 1675839776218Disabling compacts and flushes for region at 1675839776218Disabling writes for close at 1675839776219 (+1 ms)Writing region close event to WAL at 1675839776227 (+8 ms)Closed at 1675839776227 2023-02-08 07:02:56,230 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:02:56,230 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:02:56,233 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:02:56,235 INFO [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:56,236 DEBUG [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1 2023-02-08 07:02:56,237 INFO [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f360121ad077c24ab1da4ed41793d1 columnFamilyName f1 2023-02-08 07:02:56,243 DEBUG [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1/testWithMapReduce=e5f360121ad077c24ab1da4ed41793d1-4f64d484f2af4203800d1e56fc7965bf 2023-02-08 07:02:56,243 INFO [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] regionserver.HStore(310): Store=e5f360121ad077c24ab1da4ed41793d1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:56,243 INFO [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:56,244 DEBUG [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2 2023-02-08 07:02:56,245 INFO [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f360121ad077c24ab1da4ed41793d1 columnFamilyName f2 2023-02-08 07:02:56,252 DEBUG [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] regionserver.HStore(539): loaded hdfs://localhost:44277/user/jenkins/test-data/444eb595-f723-a0b9-d779-cf571155adde/testWithMapReduceMultiRegion/c47f5807-ff84-413d-9144-6fd7074b61d1/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2/testWithMapReduce=e5f360121ad077c24ab1da4ed41793d1-86e01e61208f4200aa229b5c3b106cfc 2023-02-08 07:02:56,252 INFO [StoreOpener-e5f360121ad077c24ab1da4ed41793d1-1] regionserver.HStore(310): Store=e5f360121ad077c24ab1da4ed41793d1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:02:56,253 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:02:56,253 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e5f360121ad077c24ab1da4ed41793d1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61413258, jitterRate=-0.08487114310264587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:02:56,253 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e5f360121ad077c24ab1da4ed41793d1: Writing region info on filesystem at 1675839776233Initializing all the Stores at 1675839776234 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839776234Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839776235 (+1 ms)Region opened successfully at 1675839776253 (+18 ms) 2023-02-08 07:02:56,282 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e5f360121ad077c24ab1da4ed41793d1, disabling compactions & flushes 2023-02-08 07:02:56,282 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:56,282 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:56,282 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. after waiting 0 ms 2023-02-08 07:02:56,282 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:56,285 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:56,285 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e5f360121ad077c24ab1da4ed41793d1: Waiting for close lock at 1675839776282Disabling compacts and flushes for region at 1675839776282Disabling writes for close at 1675839776282Writing region close event to WAL at 1675839776285 (+3 ms)Closed at 1675839776285 2023-02-08 07:02:57,239 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:57,239 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:57,244 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-08 07:02:57,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-08 07:02:57,250 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:57,251 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:57,251 INFO [Listener at localhost/32917] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-08 07:02:57,252 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-08 07:02:57,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-08 07:02:57,263 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839777263"}]},"ts":"1675839777263"} 2023-02-08 07:02:57,263 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:57,263 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:57,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 07:02:57,268 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-08 07:02:57,270 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-08 07:02:57,273 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=81797aa7b2c7e5c03d341ad6d4b22cfa, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=63a9a028567d15ba686c122d4dc3a217, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=00061a9a43bd799484ccc17c89947e50, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e5f360121ad077c24ab1da4ed41793d1, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0ff96987c3f42b10504e567f52ec0b44, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cf462321411027fc65d6e0abc079dbba, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=87858cdb09f5de238cd652bb0c760c8f, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d5df91c41ae95ce6206bc1458402cd2c, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3bba034a798e8ebbcd952eeea7bc0671, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ccb06f81840bf3b7fd0ca95472b51e8d, UNASSIGN}] 2023-02-08 07:02:57,275 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0ff96987c3f42b10504e567f52ec0b44, UNASSIGN 2023-02-08 07:02:57,275 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=00061a9a43bd799484ccc17c89947e50, UNASSIGN 2023-02-08 07:02:57,275 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=63a9a028567d15ba686c122d4dc3a217, UNASSIGN 2023-02-08 07:02:57,276 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ccb06f81840bf3b7fd0ca95472b51e8d, UNASSIGN 2023-02-08 07:02:57,276 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e5f360121ad077c24ab1da4ed41793d1, UNASSIGN 2023-02-08 07:02:57,276 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0ff96987c3f42b10504e567f52ec0b44, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:57,277 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=00061a9a43bd799484ccc17c89947e50, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:57,277 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777276"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839777276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839777276"}]},"ts":"1675839777276"} 2023-02-08 07:02:57,277 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777276"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839777276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839777276"}]},"ts":"1675839777276"} 2023-02-08 07:02:57,277 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e5f360121ad077c24ab1da4ed41793d1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:57,277 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ccb06f81840bf3b7fd0ca95472b51e8d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:57,277 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777277"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839777277"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839777277"}]},"ts":"1675839777277"} 2023-02-08 07:02:57,277 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839777277"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839777277"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839777277"}]},"ts":"1675839777277"} 2023-02-08 07:02:57,277 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=63a9a028567d15ba686c122d4dc3a217, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:57,278 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777276"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839777276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839777276"}]},"ts":"1675839777276"} 2023-02-08 07:02:57,279 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=38, state=RUNNABLE; CloseRegionProcedure 0ff96987c3f42b10504e567f52ec0b44, server=jenkins-hbase4.apache.org,41961,1675839765567}] 2023-02-08 07:02:57,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; CloseRegionProcedure ccb06f81840bf3b7fd0ca95472b51e8d, server=jenkins-hbase4.apache.org,41961,1675839765567}] 2023-02-08 07:02:57,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure e5f360121ad077c24ab1da4ed41793d1, server=jenkins-hbase4.apache.org,35063,1675839765615}] 2023-02-08 07:02:57,287 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; CloseRegionProcedure 63a9a028567d15ba686c122d4dc3a217, server=jenkins-hbase4.apache.org,41961,1675839765567}] 2023-02-08 07:02:57,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=36, state=RUNNABLE; CloseRegionProcedure 00061a9a43bd799484ccc17c89947e50, server=jenkins-hbase4.apache.org,35063,1675839765615}] 2023-02-08 07:02:57,291 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3bba034a798e8ebbcd952eeea7bc0671, UNASSIGN 2023-02-08 07:02:57,291 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d5df91c41ae95ce6206bc1458402cd2c, UNASSIGN 2023-02-08 07:02:57,292 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=87858cdb09f5de238cd652bb0c760c8f, UNASSIGN 2023-02-08 07:02:57,293 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=d5df91c41ae95ce6206bc1458402cd2c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:57,293 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=3bba034a798e8ebbcd952eeea7bc0671, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:57,293 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839777293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839777293"}]},"ts":"1675839777293"} 2023-02-08 07:02:57,293 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839777293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839777293"}]},"ts":"1675839777293"} 2023-02-08 07:02:57,294 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cf462321411027fc65d6e0abc079dbba, UNASSIGN 2023-02-08 07:02:57,294 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=81797aa7b2c7e5c03d341ad6d4b22cfa, UNASSIGN 2023-02-08 07:02:57,294 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=87858cdb09f5de238cd652bb0c760c8f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:57,294 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777294"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839777294"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839777294"}]},"ts":"1675839777294"} 2023-02-08 07:02:57,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=41, state=RUNNABLE; CloseRegionProcedure d5df91c41ae95ce6206bc1458402cd2c, server=jenkins-hbase4.apache.org,41961,1675839765567}] 2023-02-08 07:02:57,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=42, state=RUNNABLE; CloseRegionProcedure 3bba034a798e8ebbcd952eeea7bc0671, server=jenkins-hbase4.apache.org,35063,1675839765615}] 2023-02-08 07:02:57,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 87858cdb09f5de238cd652bb0c760c8f, server=jenkins-hbase4.apache.org,35063,1675839765615}] 2023-02-08 07:02:57,298 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=cf462321411027fc65d6e0abc079dbba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:57,299 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=81797aa7b2c7e5c03d341ad6d4b22cfa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:57,299 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777298"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839777298"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839777298"}]},"ts":"1675839777298"} 2023-02-08 07:02:57,299 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839777299"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839777299"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839777299"}]},"ts":"1675839777299"} 2023-02-08 07:02:57,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure cf462321411027fc65d6e0abc079dbba, server=jenkins-hbase4.apache.org,41961,1675839765567}] 2023-02-08 07:02:57,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 81797aa7b2c7e5c03d341ad6d4b22cfa, server=jenkins-hbase4.apache.org,35063,1675839765615}] 2023-02-08 07:02:57,365 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:57,365 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:57,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 07:02:57,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:57,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:57,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e5f360121ad077c24ab1da4ed41793d1, disabling compactions & flushes 2023-02-08 07:02:57,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 63a9a028567d15ba686c122d4dc3a217, disabling compactions & flushes 2023-02-08 07:02:57,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:57,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:57,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:57,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:57,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. after waiting 0 ms 2023-02-08 07:02:57,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:57,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. after waiting 0 ms 2023-02-08 07:02:57,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:57,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:02:57,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1. 2023-02-08 07:02:57,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e5f360121ad077c24ab1da4ed41793d1: Waiting for close lock at 1675839777441Running coprocessor pre-close hooks at 1675839777441Disabling compacts and flushes for region at 1675839777441Disabling writes for close at 1675839777442 (+1 ms)Writing region close event to WAL at 1675839777456 (+14 ms)Running coprocessor post-close hooks at 1675839777460 (+4 ms)Closed at 1675839777461 (+1 ms) 2023-02-08 07:02:57,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:57,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:57,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 87858cdb09f5de238cd652bb0c760c8f, disabling compactions & flushes 2023-02-08 07:02:57,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:57,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:57,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. after waiting 0 ms 2023-02-08 07:02:57,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:57,465 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e5f360121ad077c24ab1da4ed41793d1, regionState=CLOSED 2023-02-08 07:02:57,465 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839777464"}]},"ts":"1675839777464"} 2023-02-08 07:02:57,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:02:57,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217. 2023-02-08 07:02:57,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 63a9a028567d15ba686c122d4dc3a217: Waiting for close lock at 1675839777442Running coprocessor pre-close hooks at 1675839777442Disabling compacts and flushes for region at 1675839777442Disabling writes for close at 1675839777442Writing region close event to WAL at 1675839777453 (+11 ms)Running coprocessor post-close hooks at 1675839777470 (+17 ms)Closed at 1675839777470 2023-02-08 07:02:57,472 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-08 07:02:57,472 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure e5f360121ad077c24ab1da4ed41793d1, server=jenkins-hbase4.apache.org,35063,1675839765615 in 182 msec 2023-02-08 07:02:57,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:57,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:57,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0ff96987c3f42b10504e567f52ec0b44, disabling compactions & flushes 2023-02-08 07:02:57,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:57,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:57,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. after waiting 0 ms 2023-02-08 07:02:57,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:57,474 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=63a9a028567d15ba686c122d4dc3a217, regionState=CLOSED 2023-02-08 07:02:57,474 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839777473"}]},"ts":"1675839777473"} 2023-02-08 07:02:57,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e5f360121ad077c24ab1da4ed41793d1, UNASSIGN in 201 msec 2023-02-08 07:02:57,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-02-08 07:02:57,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; CloseRegionProcedure 63a9a028567d15ba686c122d4dc3a217, server=jenkins-hbase4.apache.org,41961,1675839765567 in 189 msec 2023-02-08 07:02:57,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:02:57,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=63a9a028567d15ba686c122d4dc3a217, UNASSIGN in 211 msec 2023-02-08 07:02:57,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f. 2023-02-08 07:02:57,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 87858cdb09f5de238cd652bb0c760c8f: Waiting for close lock at 1675839777464Running coprocessor pre-close hooks at 1675839777464Disabling compacts and flushes for region at 1675839777464Disabling writes for close at 1675839777464Writing region close event to WAL at 1675839777469 (+5 ms)Running coprocessor post-close hooks at 1675839777483 (+14 ms)Closed at 1675839777484 (+1 ms) 2023-02-08 07:02:57,487 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=87858cdb09f5de238cd652bb0c760c8f, regionState=CLOSED 2023-02-08 07:02:57,487 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777487"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839777487"}]},"ts":"1675839777487"} 2023-02-08 07:02:57,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:02:57,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44. 2023-02-08 07:02:57,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:57,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:57,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0ff96987c3f42b10504e567f52ec0b44: Waiting for close lock at 1675839777473Running coprocessor pre-close hooks at 1675839777473Disabling compacts and flushes for region at 1675839777473Disabling writes for close at 1675839777473Writing region close event to WAL at 1675839777484 (+11 ms)Running coprocessor post-close hooks at 1675839777489 (+5 ms)Closed at 1675839777489 2023-02-08 07:02:57,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 00061a9a43bd799484ccc17c89947e50, disabling compactions & flushes 2023-02-08 07:02:57,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:57,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:57,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. after waiting 0 ms 2023-02-08 07:02:57,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:57,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:57,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:57,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ccb06f81840bf3b7fd0ca95472b51e8d, disabling compactions & flushes 2023-02-08 07:02:57,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-08 07:02:57,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 87858cdb09f5de238cd652bb0c760c8f, server=jenkins-hbase4.apache.org,35063,1675839765615 in 192 msec 2023-02-08 07:02:57,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:57,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:57,494 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0ff96987c3f42b10504e567f52ec0b44, regionState=CLOSED 2023-02-08 07:02:57,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777494"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839777494"}]},"ts":"1675839777494"} 2023-02-08 07:02:57,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. after waiting 0 ms 2023-02-08 07:02:57,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:57,495 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=87858cdb09f5de238cd652bb0c760c8f, UNASSIGN in 222 msec 2023-02-08 07:02:57,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=38 2023-02-08 07:02:57,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=38, state=SUCCESS; CloseRegionProcedure 0ff96987c3f42b10504e567f52ec0b44, server=jenkins-hbase4.apache.org,41961,1675839765567 in 216 msec 2023-02-08 07:02:57,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0ff96987c3f42b10504e567f52ec0b44, UNASSIGN in 228 msec 2023-02-08 07:02:57,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 07:02:57,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:02:57,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d. 2023-02-08 07:02:57,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ccb06f81840bf3b7fd0ca95472b51e8d: Waiting for close lock at 1675839777493Running coprocessor pre-close hooks at 1675839777493Disabling compacts and flushes for region at 1675839777493Disabling writes for close at 1675839777494 (+1 ms)Writing region close event to WAL at 1675839777512 (+18 ms)Running coprocessor post-close hooks at 1675839777517 (+5 ms)Closed at 1675839777517 2023-02-08 07:02:57,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50. 2023-02-08 07:02:57,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 00061a9a43bd799484ccc17c89947e50: Waiting for close lock at 1675839777490Running coprocessor pre-close hooks at 1675839777490Disabling compacts and flushes for region at 1675839777490Disabling writes for close at 1675839777490Writing region close event to WAL at 1675839777512 (+22 ms)Running coprocessor post-close hooks at 1675839777518 (+6 ms)Closed at 1675839777518 2023-02-08 07:02:57,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:57,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:57,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cf462321411027fc65d6e0abc079dbba, disabling compactions & flushes 2023-02-08 07:02:57,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:57,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:57,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. after waiting 0 ms 2023-02-08 07:02:57,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:57,520 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ccb06f81840bf3b7fd0ca95472b51e8d, regionState=CLOSED 2023-02-08 07:02:57,521 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839777520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839777520"}]},"ts":"1675839777520"} 2023-02-08 07:02:57,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:57,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:57,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3bba034a798e8ebbcd952eeea7bc0671, disabling compactions & flushes 2023-02-08 07:02:57,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:57,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:57,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. after waiting 0 ms 2023-02-08 07:02:57,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:57,521 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=00061a9a43bd799484ccc17c89947e50, regionState=CLOSED 2023-02-08 07:02:57,522 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777521"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839777521"}]},"ts":"1675839777521"} 2023-02-08 07:02:57,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:02:57,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671. 2023-02-08 07:02:57,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3bba034a798e8ebbcd952eeea7bc0671: Waiting for close lock at 1675839777521Running coprocessor pre-close hooks at 1675839777521Disabling compacts and flushes for region at 1675839777521Disabling writes for close at 1675839777521Writing region close event to WAL at 1675839777524 (+3 ms)Running coprocessor post-close hooks at 1675839777529 (+5 ms)Closed at 1675839777531 (+2 ms) 2023-02-08 07:02:57,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=36 2023-02-08 07:02:57,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=36, state=SUCCESS; CloseRegionProcedure 00061a9a43bd799484ccc17c89947e50, server=jenkins-hbase4.apache.org,35063,1675839765615 in 236 msec 2023-02-08 07:02:57,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-02-08 07:02:57,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; CloseRegionProcedure ccb06f81840bf3b7fd0ca95472b51e8d, server=jenkins-hbase4.apache.org,41961,1675839765567 in 243 msec 2023-02-08 07:02:57,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:57,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:57,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 81797aa7b2c7e5c03d341ad6d4b22cfa, disabling compactions & flushes 2023-02-08 07:02:57,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:57,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:57,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. after waiting 0 ms 2023-02-08 07:02:57,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:57,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=00061a9a43bd799484ccc17c89947e50, UNASSIGN in 260 msec 2023-02-08 07:02:57,534 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=3bba034a798e8ebbcd952eeea7bc0671, regionState=CLOSED 2023-02-08 07:02:57,534 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777534"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839777534"}]},"ts":"1675839777534"} 2023-02-08 07:02:57,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ccb06f81840bf3b7fd0ca95472b51e8d, UNASSIGN in 260 msec 2023-02-08 07:02:57,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:02:57,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3bba034a798e8ebbcd952eeea7bc0671, UNASSIGN in 266 msec 2023-02-08 07:02:57,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=42 2023-02-08 07:02:57,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=42, state=SUCCESS; CloseRegionProcedure 3bba034a798e8ebbcd952eeea7bc0671, server=jenkins-hbase4.apache.org,35063,1675839765615 in 239 msec 2023-02-08 07:02:57,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba. 2023-02-08 07:02:57,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cf462321411027fc65d6e0abc079dbba: Waiting for close lock at 1675839777520Running coprocessor pre-close hooks at 1675839777520Disabling compacts and flushes for region at 1675839777520Disabling writes for close at 1675839777520Writing region close event to WAL at 1675839777530 (+10 ms)Running coprocessor post-close hooks at 1675839777553 (+23 ms)Closed at 1675839777554 (+1 ms) 2023-02-08 07:02:57,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 07:02:57,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa. 2023-02-08 07:02:57,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 81797aa7b2c7e5c03d341ad6d4b22cfa: Waiting for close lock at 1675839777533Running coprocessor pre-close hooks at 1675839777533Disabling compacts and flushes for region at 1675839777533Disabling writes for close at 1675839777533Writing region close event to WAL at 1675839777534 (+1 ms)Running coprocessor post-close hooks at 1675839777555 (+21 ms)Closed at 1675839777556 (+1 ms) 2023-02-08 07:02:57,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:57,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:57,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d5df91c41ae95ce6206bc1458402cd2c, disabling compactions & flushes 2023-02-08 07:02:57,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:57,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:57,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. after waiting 0 ms 2023-02-08 07:02:57,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:57,558 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=cf462321411027fc65d6e0abc079dbba, regionState=CLOSED 2023-02-08 07:02:57,558 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839777558"}]},"ts":"1675839777558"} 2023-02-08 07:02:57,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:57,559 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=81797aa7b2c7e5c03d341ad6d4b22cfa, regionState=CLOSED 2023-02-08 07:02:57,559 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839777559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839777559"}]},"ts":"1675839777559"} 2023-02-08 07:02:57,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-08 07:02:57,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure cf462321411027fc65d6e0abc079dbba, server=jenkins-hbase4.apache.org,41961,1675839765567 in 259 msec 2023-02-08 07:02:57,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cf462321411027fc65d6e0abc079dbba, UNASSIGN in 291 msec 2023-02-08 07:02:57,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-08 07:02:57,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 81797aa7b2c7e5c03d341ad6d4b22cfa, server=jenkins-hbase4.apache.org,35063,1675839765615 in 263 msec 2023-02-08 07:02:57,567 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:57,568 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:57,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 07:02:57,570 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=81797aa7b2c7e5c03d341ad6d4b22cfa, UNASSIGN in 296 msec 2023-02-08 07:02:57,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:02:57,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c. 2023-02-08 07:02:57,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d5df91c41ae95ce6206bc1458402cd2c: Waiting for close lock at 1675839777557Running coprocessor pre-close hooks at 1675839777557Disabling compacts and flushes for region at 1675839777557Disabling writes for close at 1675839777557Writing region close event to WAL at 1675839777573 (+16 ms)Running coprocessor post-close hooks at 1675839777577 (+4 ms)Closed at 1675839777578 (+1 ms) 2023-02-08 07:02:57,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:57,581 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=d5df91c41ae95ce6206bc1458402cd2c, regionState=CLOSED 2023-02-08 07:02:57,581 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839777581"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839777581"}]},"ts":"1675839777581"} 2023-02-08 07:02:57,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=41 2023-02-08 07:02:57,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=41, state=SUCCESS; CloseRegionProcedure d5df91c41ae95ce6206bc1458402cd2c, server=jenkins-hbase4.apache.org,41961,1675839765567 in 287 msec 2023-02-08 07:02:57,587 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=33 2023-02-08 07:02:57,588 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d5df91c41ae95ce6206bc1458402cd2c, UNASSIGN in 314 msec 2023-02-08 07:02:57,588 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839777588"}]},"ts":"1675839777588"} 2023-02-08 07:02:57,605 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-08 07:02:57,607 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-08 07:02:57,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 355 msec 2023-02-08 07:02:57,870 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:57,870 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:57,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 07:02:57,872 INFO [Listener at localhost/32917] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-08 07:02:57,873 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:57,873 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:57,878 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-08 07:02:57,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-08 07:02:57,886 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 07:02:57,888 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 07:02:57,888 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:57,888 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:57,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-08 07:02:57,902 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:57,902 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:57,902 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:57,902 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:57,902 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:57,902 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:57,902 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:57,902 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:57,906 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/f1, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/f2, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/recovered.edits] 2023-02-08 07:02:57,909 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/recovered.edits] 2023-02-08 07:02:57,909 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/recovered.edits] 2023-02-08 07:02:57,909 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/recovered.edits] 2023-02-08 07:02:57,909 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/recovered.edits] 2023-02-08 07:02:57,910 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/recovered.edits] 2023-02-08 07:02:57,910 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/recovered.edits] 2023-02-08 07:02:57,916 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/recovered.edits] 2023-02-08 07:02:57,934 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1/e9d2b3b997794c079d6505bf63f37f13 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1/e9d2b3b997794c079d6505bf63f37f13 2023-02-08 07:02:57,934 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1/0e095c4939624c7b9a2475f41cdc06c6 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1/0e095c4939624c7b9a2475f41cdc06c6 2023-02-08 07:02:57,936 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1/03de7e811efc48d9bcb558cd8ad0f22e to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1/03de7e811efc48d9bcb558cd8ad0f22e 2023-02-08 07:02:57,936 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1/622fd9c6fe5345e98ad6f6ff99f31a9a to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1/622fd9c6fe5345e98ad6f6ff99f31a9a 2023-02-08 07:02:57,936 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1/63f3533efdc34cf7b788f6aed639806e to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1/63f3533efdc34cf7b788f6aed639806e 2023-02-08 07:02:57,937 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1/47ddf801886b4e8482eb891b8c27ae6f to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1/47ddf801886b4e8482eb891b8c27ae6f 2023-02-08 07:02:57,938 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1/4f64d484f2af4203800d1e56fc7965bf to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1/4f64d484f2af4203800d1e56fc7965bf 2023-02-08 07:02:57,939 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1/f62a71f31521448b9b7fa01dfb6c2bcb to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f1/f62a71f31521448b9b7fa01dfb6c2bcb 2023-02-08 07:02:57,940 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1/9287d5645dc04e1a9e1319da0606b612 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f1/9287d5645dc04e1a9e1319da0606b612 2023-02-08 07:02:57,941 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/recovered.edits/6.seqid to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa/recovered.edits/6.seqid 2023-02-08 07:02:57,941 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1/f15fc3cecca8415fa9558ff3a831212a to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f1/f15fc3cecca8415fa9558ff3a831212a 2023-02-08 07:02:57,941 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1/778de4eb4fa84338abaebf98e58c4381 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f1/778de4eb4fa84338abaebf98e58c4381 2023-02-08 07:02:57,941 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1/fede7e8a79714309b0fd638db59f4d56 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f1/fede7e8a79714309b0fd638db59f4d56 2023-02-08 07:02:57,942 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1/de0e0297de0b4229824a87d6d452db88 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f1/de0e0297de0b4229824a87d6d452db88 2023-02-08 07:02:57,943 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/81797aa7b2c7e5c03d341ad6d4b22cfa 2023-02-08 07:02:57,943 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:57,948 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1/5073b11b7c6445c495061eeec5daa561 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f1/5073b11b7c6445c495061eeec5daa561 2023-02-08 07:02:57,949 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/recovered.edits] 2023-02-08 07:02:57,952 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2/812a15f0a24b4caf9301afee7d4b0ed4 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2/812a15f0a24b4caf9301afee7d4b0ed4 2023-02-08 07:02:57,952 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2/2d519f836dd6447aa75ca70fc3b634f2 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2/2d519f836dd6447aa75ca70fc3b634f2 2023-02-08 07:02:57,953 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2/69a4ca55beea4e7888e7ae9fc6dc73b9 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2/69a4ca55beea4e7888e7ae9fc6dc73b9 2023-02-08 07:02:57,953 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2/cafe5d841467437985f5726716e8cfa7 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2/cafe5d841467437985f5726716e8cfa7 2023-02-08 07:02:57,953 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2/2ca47789699e4b7ab856cf3b066dae7a to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2/2ca47789699e4b7ab856cf3b066dae7a 2023-02-08 07:02:57,953 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2/017536cbf4374bdda41aa156258b0b2f to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2/017536cbf4374bdda41aa156258b0b2f 2023-02-08 07:02:57,957 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2/824ddbaaa4b2483bb840f7753dbea393 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/f2/824ddbaaa4b2483bb840f7753dbea393 2023-02-08 07:02:57,957 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2/c7f3a9e9e1d944298c3ba19393f01641 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/f2/c7f3a9e9e1d944298c3ba19393f01641 2023-02-08 07:02:57,958 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2/c8f6403345c44c5bb590aa834c2bee3a to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/f2/c8f6403345c44c5bb590aa834c2bee3a 2023-02-08 07:02:57,958 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2/5bc400f00c524a259c8a434a09051c15 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2/5bc400f00c524a259c8a434a09051c15 2023-02-08 07:02:57,958 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2/62ef7883965a40678930930d20adf9db to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/f2/62ef7883965a40678930930d20adf9db 2023-02-08 07:02:57,959 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2/60cd6f2d94ae4891aabdb9401120ee8f to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/f2/60cd6f2d94ae4891aabdb9401120ee8f 2023-02-08 07:02:57,959 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2/dcbd4660ef5b4bd1a43eec837dd6cf3f to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/f2/dcbd4660ef5b4bd1a43eec837dd6cf3f 2023-02-08 07:02:57,962 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1/38649e54d68d4686a59789d5d518a7be to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1/38649e54d68d4686a59789d5d518a7be 2023-02-08 07:02:57,963 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2/86e01e61208f4200aa229b5c3b106cfc to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/f2/86e01e61208f4200aa229b5c3b106cfc 2023-02-08 07:02:57,967 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1/c895724b473a4f1186d37af15f5f7c84 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f1/c895724b473a4f1186d37af15f5f7c84 2023-02-08 07:02:57,977 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/recovered.edits/12.seqid to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f/recovered.edits/12.seqid 2023-02-08 07:02:57,977 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/recovered.edits/12.seqid to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217/recovered.edits/12.seqid 2023-02-08 07:02:57,977 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/recovered.edits/12.seqid to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50/recovered.edits/12.seqid 2023-02-08 07:02:57,978 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/recovered.edits/12.seqid to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba/recovered.edits/12.seqid 2023-02-08 07:02:57,979 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/recovered.edits/12.seqid to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c/recovered.edits/12.seqid 2023-02-08 07:02:57,979 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/63a9a028567d15ba686c122d4dc3a217 2023-02-08 07:02:57,979 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:57,980 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/87858cdb09f5de238cd652bb0c760c8f 2023-02-08 07:02:57,980 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/recovered.edits/12.seqid to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44/recovered.edits/12.seqid 2023-02-08 07:02:57,980 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/00061a9a43bd799484ccc17c89947e50 2023-02-08 07:02:57,980 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/cf462321411027fc65d6e0abc079dbba 2023-02-08 07:02:57,980 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/d5df91c41ae95ce6206bc1458402cd2c 2023-02-08 07:02:57,981 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/0ff96987c3f42b10504e567f52ec0b44 2023-02-08 07:02:57,982 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/recovered.edits/12.seqid to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1/recovered.edits/12.seqid 2023-02-08 07:02:57,982 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/f1, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/f2, FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/recovered.edits] 2023-02-08 07:02:57,983 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/e5f360121ad077c24ab1da4ed41793d1 2023-02-08 07:02:57,983 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2/38ec24f080e94dfb9ec1ffad694ce691 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2/38ec24f080e94dfb9ec1ffad694ce691 2023-02-08 07:02:57,985 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2/ead8f61c43b94f258932d80a5e208b70 to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/f2/ead8f61c43b94f258932d80a5e208b70 2023-02-08 07:02:57,989 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/recovered.edits/12.seqid to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671/recovered.edits/12.seqid 2023-02-08 07:02:57,989 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/recovered.edits/6.seqid to hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/archive/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d/recovered.edits/6.seqid 2023-02-08 07:02:57,989 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:57,990 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:57,990 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/3bba034a798e8ebbcd952eeea7bc0671 2023-02-08 07:02:57,990 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/.tmp/data/default/testWithMapReduce/ccb06f81840bf3b7fd0ca95472b51e8d 2023-02-08 07:02:57,991 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-08 07:02:57,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-08 07:02:57,994 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 07:02:58,023 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-08 07:02:58,029 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-08 07:02:58,030 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 07:02:58,030 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-08 07:02:58,030 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839778030"}]},"ts":"9223372036854775807"} 2023-02-08 07:02:58,030 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839778030"}]},"ts":"9223372036854775807"} 2023-02-08 07:02:58,030 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839778030"}]},"ts":"9223372036854775807"} 2023-02-08 07:02:58,031 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839778030"}]},"ts":"9223372036854775807"} 2023-02-08 07:02:58,031 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839778030"}]},"ts":"9223372036854775807"} 2023-02-08 07:02:58,031 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839778030"}]},"ts":"9223372036854775807"} 2023-02-08 07:02:58,031 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839778030"}]},"ts":"9223372036854775807"} 2023-02-08 07:02:58,031 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839778030"}]},"ts":"9223372036854775807"} 2023-02-08 07:02:58,031 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839778030"}]},"ts":"9223372036854775807"} 2023-02-08 07:02:58,031 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839778030"}]},"ts":"9223372036854775807"} 2023-02-08 07:02:58,033 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-08 07:02:58,034 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 81797aa7b2c7e5c03d341ad6d4b22cfa, NAME => 'testWithMapReduce,,1675839768580.81797aa7b2c7e5c03d341ad6d4b22cfa.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 63a9a028567d15ba686c122d4dc3a217, NAME => 'testWithMapReduce,aaa,1675839768580.63a9a028567d15ba686c122d4dc3a217.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 00061a9a43bd799484ccc17c89947e50, NAME => 'testWithMapReduce,d\x84\x84,1675839768580.00061a9a43bd799484ccc17c89947e50.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => e5f360121ad077c24ab1da4ed41793d1, NAME => 'testWithMapReduce,g\xA7\xA7,1675839768580.e5f360121ad077c24ab1da4ed41793d1.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 0ff96987c3f42b10504e567f52ec0b44, NAME => 'testWithMapReduce,j\xCA\xCA,1675839768580.0ff96987c3f42b10504e567f52ec0b44.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => cf462321411027fc65d6e0abc079dbba, NAME => 'testWithMapReduce,m\xED\xED,1675839768580.cf462321411027fc65d6e0abc079dbba.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 87858cdb09f5de238cd652bb0c760c8f, NAME => 'testWithMapReduce,q\x11\x10,1675839768580.87858cdb09f5de238cd652bb0c760c8f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => d5df91c41ae95ce6206bc1458402cd2c, NAME => 'testWithMapReduce,t43,1675839768580.d5df91c41ae95ce6206bc1458402cd2c.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 3bba034a798e8ebbcd952eeea7bc0671, NAME => 'testWithMapReduce,wWV,1675839768580.3bba034a798e8ebbcd952eeea7bc0671.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => ccb06f81840bf3b7fd0ca95472b51e8d, NAME => 'testWithMapReduce,zz{,1675839768580.ccb06f81840bf3b7fd0ca95472b51e8d.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-08 07:02:58,034 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-08 07:02:58,034 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675839778034"}]},"ts":"9223372036854775807"} 2023-02-08 07:02:58,036 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-08 07:02:58,038 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 07:02:58,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 159 msec 2023-02-08 07:02:58,192 INFO [Listener at localhost/32917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:02:58,192 INFO [Listener at localhost/32917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:02:58,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-08 07:02:58,194 INFO [Listener at localhost/32917] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-08 07:02:58,194 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 07:02:58,194 INFO [Listener at localhost/32917] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 07:02:58,195 DEBUG [Listener at localhost/32917] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x437773fd to 127.0.0.1:54762 2023-02-08 07:02:58,195 DEBUG [Listener at localhost/32917] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:02:58,195 DEBUG [Listener at localhost/32917] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 07:02:58,195 DEBUG [Listener at localhost/32917] util.JVMClusterUtil(257): Found active master hash=373825230, stopped=false 2023-02-08 07:02:58,195 INFO [Listener at localhost/32917] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40701,1675839764394 2023-02-08 07:02:58,200 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:02:58,200 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:02:58,200 INFO [Listener at localhost/32917] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 07:02:58,200 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:02:58,200 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:02:58,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:02:58,202 DEBUG [Listener at localhost/32917] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2faec1ea to 127.0.0.1:54762 2023-02-08 07:02:58,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:02:58,202 DEBUG [Listener at localhost/32917] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:02:58,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:02:58,202 INFO [Listener at localhost/32917] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41961,1675839765567' ***** 2023-02-08 07:02:58,202 INFO [Listener at localhost/32917] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:02:58,202 INFO [Listener at localhost/32917] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35063,1675839765615' ***** 2023-02-08 07:02:58,202 INFO [Listener at localhost/32917] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:02:58,203 INFO [RS:1;jenkins-hbase4:35063] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:02:58,203 INFO [RS:0;jenkins-hbase4:41961] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:02:58,203 INFO [RS:0;jenkins-hbase4:41961] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:02:58,203 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:02:58,203 INFO [RS:1;jenkins-hbase4:35063] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:02:58,203 INFO [RS:0;jenkins-hbase4:41961] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:02:58,203 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:02:58,203 INFO [RS:0;jenkins-hbase4:41961] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:58,203 INFO [RS:1;jenkins-hbase4:35063] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:02:58,204 DEBUG [RS:0;jenkins-hbase4:41961] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6925ba30 to 127.0.0.1:54762 2023-02-08 07:02:58,204 DEBUG [RS:0;jenkins-hbase4:41961] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:02:58,204 INFO [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(3304): Received CLOSE for ab83db048ce8d4be0c3f9637ed8c6ed5 2023-02-08 07:02:58,204 INFO [RS:0;jenkins-hbase4:41961] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41961,1675839765567; all regions closed. 2023-02-08 07:02:58,204 INFO [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:58,204 DEBUG [RS:1;jenkins-hbase4:35063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x751e1a2a to 127.0.0.1:54762 2023-02-08 07:02:58,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ab83db048ce8d4be0c3f9637ed8c6ed5, disabling compactions & flushes 2023-02-08 07:02:58,205 DEBUG [RS:1;jenkins-hbase4:35063] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:02:58,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. 2023-02-08 07:02:58,205 INFO [RS:1;jenkins-hbase4:35063] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:02:58,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. 2023-02-08 07:02:58,205 INFO [RS:1;jenkins-hbase4:35063] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:02:58,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. after waiting 0 ms 2023-02-08 07:02:58,205 INFO [RS:1;jenkins-hbase4:35063] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:02:58,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. 2023-02-08 07:02:58,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing ab83db048ce8d4be0c3f9637ed8c6ed5 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 07:02:58,205 INFO [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 07:02:58,206 INFO [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-08 07:02:58,206 DEBUG [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, ab83db048ce8d4be0c3f9637ed8c6ed5=hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5.} 2023-02-08 07:02:58,207 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:02:58,207 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:02:58,207 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:02:58,207 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:02:58,207 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:02:58,207 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-08 07:02:58,208 DEBUG [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(1505): Waiting on 1588230740, ab83db048ce8d4be0c3f9637ed8c6ed5 2023-02-08 07:02:58,227 DEBUG [RS:0;jenkins-hbase4:41961] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/oldWALs 2023-02-08 07:02:58,228 INFO [RS:0;jenkins-hbase4:41961] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41961%2C1675839765567:(num 1675839768004) 2023-02-08 07:02:58,228 DEBUG [RS:0;jenkins-hbase4:41961] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:02:58,228 INFO [RS:0;jenkins-hbase4:41961] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:02:58,228 INFO [RS:0;jenkins-hbase4:41961] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 07:02:58,228 INFO [RS:0;jenkins-hbase4:41961] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:02:58,228 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:02:58,228 INFO [RS:0;jenkins-hbase4:41961] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:02:58,229 INFO [RS:0;jenkins-hbase4:41961] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:02:58,230 INFO [RS:0;jenkins-hbase4:41961] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41961 2023-02-08 07:02:58,244 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:02:58,244 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:58,244 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41961,1675839765567 2023-02-08 07:02:58,245 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:02:58,245 ERROR [Listener at localhost/32917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5eab4a88 rejected from java.util.concurrent.ThreadPoolExecutor@5a94c585[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:02:58,245 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41961,1675839765567] 2023-02-08 07:02:58,245 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:02:58,246 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41961,1675839765567; numProcessing=1 2023-02-08 07:02:58,246 ERROR [Listener at localhost/32917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2a385eb2 rejected from java.util.concurrent.ThreadPoolExecutor@5a94c585[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:02:58,248 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41961,1675839765567 already deleted, retry=false 2023-02-08 07:02:58,248 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41961,1675839765567 expired; onlineServers=1 2023-02-08 07:02:58,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5/.tmp/info/2664e09bd47d4b93a86d74c048e9d785 2023-02-08 07:02:58,256 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/.tmp/info/b188fd11fa66480eb911f3f4820e0224 2023-02-08 07:02:58,264 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:02:58,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5/.tmp/info/2664e09bd47d4b93a86d74c048e9d785 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5/info/2664e09bd47d4b93a86d74c048e9d785 2023-02-08 07:02:58,265 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:02:58,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5/info/2664e09bd47d4b93a86d74c048e9d785, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 07:02:58,277 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b188fd11fa66480eb911f3f4820e0224 2023-02-08 07:02:58,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ab83db048ce8d4be0c3f9637ed8c6ed5 in 73ms, sequenceid=6, compaction requested=false 2023-02-08 07:02:58,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/namespace/ab83db048ce8d4be0c3f9637ed8c6ed5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 07:02:58,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. 2023-02-08 07:02:58,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ab83db048ce8d4be0c3f9637ed8c6ed5: Waiting for close lock at 1675839778204Running coprocessor pre-close hooks at 1675839778204Disabling compacts and flushes for region at 1675839778204Disabling writes for close at 1675839778205 (+1 ms)Obtaining lock to block concurrent updates at 1675839778205Preparing flush snapshotting stores in ab83db048ce8d4be0c3f9637ed8c6ed5 at 1675839778205Finished memstore snapshotting hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675839778206 (+1 ms)Flushing stores of hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. at 1675839778207 (+1 ms)Flushing ab83db048ce8d4be0c3f9637ed8c6ed5/info: creating writer at 1675839778207Flushing ab83db048ce8d4be0c3f9637ed8c6ed5/info: appending metadata at 1675839778226 (+19 ms)Flushing ab83db048ce8d4be0c3f9637ed8c6ed5/info: closing flushed file at 1675839778226Flushing ab83db048ce8d4be0c3f9637ed8c6ed5/info: reopening flushed file at 1675839778265 (+39 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ab83db048ce8d4be0c3f9637ed8c6ed5 in 73ms, sequenceid=6, compaction requested=false at 1675839778278 (+13 ms)Writing region close event to WAL at 1675839778282 (+4 ms)Running coprocessor post-close hooks at 1675839778289 (+7 ms)Closed at 1675839778290 (+1 ms) 2023-02-08 07:02:58,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675839767542.ab83db048ce8d4be0c3f9637ed8c6ed5. 2023-02-08 07:02:58,302 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/.tmp/rep_barrier/2395ccdd4d5c45a196fc9427e3989b88 2023-02-08 07:02:58,310 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2395ccdd4d5c45a196fc9427e3989b88 2023-02-08 07:02:58,331 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/.tmp/table/c0c0b7d8c89c4fb288b0b19094c0132f 2023-02-08 07:02:58,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0c0b7d8c89c4fb288b0b19094c0132f 2023-02-08 07:02:58,338 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/.tmp/info/b188fd11fa66480eb911f3f4820e0224 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/info/b188fd11fa66480eb911f3f4820e0224 2023-02-08 07:02:58,344 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b188fd11fa66480eb911f3f4820e0224 2023-02-08 07:02:58,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/info/b188fd11fa66480eb911f3f4820e0224, entries=30, sequenceid=57, filesize=7.9 K 2023-02-08 07:02:58,346 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/.tmp/rep_barrier/2395ccdd4d5c45a196fc9427e3989b88 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/rep_barrier/2395ccdd4d5c45a196fc9427e3989b88 2023-02-08 07:02:58,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2395ccdd4d5c45a196fc9427e3989b88 2023-02-08 07:02:58,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/rep_barrier/2395ccdd4d5c45a196fc9427e3989b88, entries=10, sequenceid=57, filesize=5.9 K 2023-02-08 07:02:58,353 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/.tmp/table/c0c0b7d8c89c4fb288b0b19094c0132f as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/table/c0c0b7d8c89c4fb288b0b19094c0132f 2023-02-08 07:02:58,358 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0c0b7d8c89c4fb288b0b19094c0132f 2023-02-08 07:02:58,359 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/table/c0c0b7d8c89c4fb288b0b19094c0132f, entries=13, sequenceid=57, filesize=5.9 K 2023-02-08 07:02:58,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 153ms, sequenceid=57, compaction requested=false 2023-02-08 07:02:58,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-08 07:02:58,374 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 07:02:58,375 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:02:58,375 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839778206Running coprocessor pre-close hooks at 1675839778206Disabling compacts and flushes for region at 1675839778206Disabling writes for close at 1675839778207 (+1 ms)Obtaining lock to block concurrent updates at 1675839778207Preparing flush snapshotting stores in 1588230740 at 1675839778207Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1675839778207Flushing stores of hbase:meta,,1.1588230740 at 1675839778208 (+1 ms)Flushing 1588230740/info: creating writer at 1675839778209 (+1 ms)Flushing 1588230740/info: appending metadata at 1675839778233 (+24 ms)Flushing 1588230740/info: closing flushed file at 1675839778233Flushing 1588230740/rep_barrier: creating writer at 1675839778277 (+44 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675839778288 (+11 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675839778288Flushing 1588230740/table: creating writer at 1675839778311 (+23 ms)Flushing 1588230740/table: appending metadata at 1675839778314 (+3 ms)Flushing 1588230740/table: closing flushed file at 1675839778315 (+1 ms)Flushing 1588230740/info: reopening flushed file at 1675839778339 (+24 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675839778346 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1675839778354 (+8 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 153ms, sequenceid=57, compaction requested=false at 1675839778360 (+6 ms)Writing region close event to WAL at 1675839778369 (+9 ms)Running coprocessor post-close hooks at 1675839778374 (+5 ms)Closed at 1675839778375 (+1 ms) 2023-02-08 07:02:58,375 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 07:02:58,398 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:02:58,398 INFO [RS:0;jenkins-hbase4:41961] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41961,1675839765567; zookeeper connection closed. 2023-02-08 07:02:58,399 ERROR [Listener at localhost/32917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5287fec7 rejected from java.util.concurrent.ThreadPoolExecutor@5a94c585[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:02:58,399 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:41961-0x10032bd5def0001, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:02:58,399 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@744b481e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@744b481e 2023-02-08 07:02:58,399 ERROR [Listener at localhost/32917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@171ca377 rejected from java.util.concurrent.ThreadPoolExecutor@5a94c585[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:02:58,409 INFO [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35063,1675839765615; all regions closed. 2023-02-08 07:02:58,417 DEBUG [RS:1;jenkins-hbase4:35063] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/oldWALs 2023-02-08 07:02:58,417 INFO [RS:1;jenkins-hbase4:35063] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35063%2C1675839765615.meta:.meta(num 1675839767255) 2023-02-08 07:02:58,423 DEBUG [RS:1;jenkins-hbase4:35063] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/oldWALs 2023-02-08 07:02:58,423 INFO [RS:1;jenkins-hbase4:35063] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35063%2C1675839765615:(num 1675839768005) 2023-02-08 07:02:58,423 DEBUG [RS:1;jenkins-hbase4:35063] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:02:58,423 INFO [RS:1;jenkins-hbase4:35063] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:02:58,424 INFO [RS:1;jenkins-hbase4:35063] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 07:02:58,424 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:02:58,425 INFO [RS:1;jenkins-hbase4:35063] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35063 2023-02-08 07:02:58,428 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:02:58,428 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35063,1675839765615 2023-02-08 07:02:58,429 ERROR [Listener at localhost/32917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6859460c rejected from java.util.concurrent.ThreadPoolExecutor@6c66dfdf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:02:58,429 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35063,1675839765615] 2023-02-08 07:02:58,429 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35063,1675839765615; numProcessing=2 2023-02-08 07:02:58,432 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35063,1675839765615 already deleted, retry=false 2023-02-08 07:02:58,432 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35063,1675839765615 expired; onlineServers=0 2023-02-08 07:02:58,432 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40701,1675839764394' ***** 2023-02-08 07:02:58,432 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 07:02:58,433 DEBUG [M:0;jenkins-hbase4:40701] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3080072f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:02:58,433 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40701,1675839764394 2023-02-08 07:02:58,433 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40701,1675839764394; all regions closed. 2023-02-08 07:02:58,435 DEBUG [M:0;jenkins-hbase4:40701] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:02:58,435 DEBUG [M:0;jenkins-hbase4:40701] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 07:02:58,435 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 07:02:58,435 DEBUG [M:0;jenkins-hbase4:40701] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 07:02:58,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839766730] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839766730,5,FailOnTimeoutGroup] 2023-02-08 07:02:58,435 INFO [M:0;jenkins-hbase4:40701] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 07:02:58,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839766731] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839766731,5,FailOnTimeoutGroup] 2023-02-08 07:02:58,436 INFO [M:0;jenkins-hbase4:40701] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 07:02:58,437 INFO [M:0;jenkins-hbase4:40701] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 07:02:58,437 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 07:02:58,437 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:02:58,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:02:58,437 DEBUG [M:0;jenkins-hbase4:40701] master.HMaster(1502): Stopping service threads 2023-02-08 07:02:58,438 INFO [M:0;jenkins-hbase4:40701] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 07:02:58,439 ERROR [M:0;jenkins-hbase4:40701] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-08 07:02:58,439 INFO [M:0;jenkins-hbase4:40701] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 07:02:58,439 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 07:02:58,440 DEBUG [M:0;jenkins-hbase4:40701] zookeeper.ZKUtil(398): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 07:02:58,440 WARN [M:0;jenkins-hbase4:40701] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 07:02:58,440 INFO [M:0;jenkins-hbase4:40701] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 07:02:58,440 INFO [M:0;jenkins-hbase4:40701] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 07:02:58,441 DEBUG [M:0;jenkins-hbase4:40701] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:02:58,441 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:02:58,441 DEBUG [M:0;jenkins-hbase4:40701] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:02:58,441 DEBUG [M:0;jenkins-hbase4:40701] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:02:58,441 DEBUG [M:0;jenkins-hbase4:40701] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:02:58,441 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=158.94 KB heapSize=191.80 KB 2023-02-08 07:02:58,458 INFO [M:0;jenkins-hbase4:40701] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=158.94 KB at sequenceid=356 (bloomFilter=true), to=hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4a951066be294cdfad86693086dd1b76 2023-02-08 07:02:58,464 DEBUG [M:0;jenkins-hbase4:40701] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4a951066be294cdfad86693086dd1b76 as hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4a951066be294cdfad86693086dd1b76 2023-02-08 07:02:58,470 INFO [M:0;jenkins-hbase4:40701] regionserver.HStore(1080): Added hdfs://localhost:44277/user/jenkins/test-data/6327eed4-681f-cd43-305c-2ea465658a99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4a951066be294cdfad86693086dd1b76, entries=53, sequenceid=356, filesize=10.4 K 2023-02-08 07:02:58,471 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegion(2947): Finished flush of dataSize ~158.94 KB/162759, heapSize ~191.78 KB/196384, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=356, compaction requested=false 2023-02-08 07:02:58,473 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:02:58,473 DEBUG [M:0;jenkins-hbase4:40701] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839778441Disabling compacts and flushes for region at 1675839778441Disabling writes for close at 1675839778441Obtaining lock to block concurrent updates at 1675839778441Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675839778441Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=162759, getHeapSize=196384, getOffHeapSize=0, getCellsCount=441 at 1675839778441Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675839778442 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675839778443 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675839778448 (+5 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675839778448Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675839778465 (+17 ms)Finished flush of dataSize ~158.94 KB/162759, heapSize ~191.78 KB/196384, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=356, compaction requested=false at 1675839778471 (+6 ms)Writing region close event to WAL at 1675839778473 (+2 ms)Closed at 1675839778473 2023-02-08 07:02:58,477 INFO [M:0;jenkins-hbase4:40701] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 07:02:58,477 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:02:58,478 INFO [M:0;jenkins-hbase4:40701] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40701 2023-02-08 07:02:58,481 DEBUG [M:0;jenkins-hbase4:40701] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40701,1675839764394 already deleted, retry=false 2023-02-08 07:02:58,799 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:02:58,799 INFO [M:0;jenkins-hbase4:40701] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40701,1675839764394; zookeeper connection closed. 2023-02-08 07:02:58,800 ERROR [Listener at localhost/32917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4af1cf36 rejected from java.util.concurrent.ThreadPoolExecutor@604fe08d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:02:58,800 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): master:40701-0x10032bd5def0000, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:02:58,800 ERROR [Listener at localhost/32917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@20d3e23e rejected from java.util.concurrent.ThreadPoolExecutor@604fe08d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:02:58,900 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:02:58,900 INFO [RS:1;jenkins-hbase4:35063] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35063,1675839765615; zookeeper connection closed. 2023-02-08 07:02:58,900 ERROR [Listener at localhost/32917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3accae78 rejected from java.util.concurrent.ThreadPoolExecutor@6c66dfdf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:02:58,900 DEBUG [Listener at localhost/32917-EventThread] zookeeper.ZKWatcher(600): regionserver:35063-0x10032bd5def0002, quorum=127.0.0.1:54762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:02:58,900 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3a6d9cef] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3a6d9cef 2023-02-08 07:02:58,900 ERROR [Listener at localhost/32917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@42c55ae3 rejected from java.util.concurrent.ThreadPoolExecutor@6c66dfdf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:02:58,901 INFO [Listener at localhost/32917] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 07:02:58,901 WARN [Listener at localhost/32917] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:02:58,906 INFO [Listener at localhost/32917] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:02:59,010 WARN [BP-2106148565-172.31.14.131-1675839761008 heartbeating to localhost/127.0.0.1:44277] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:02:59,010 WARN [BP-2106148565-172.31.14.131-1675839761008 heartbeating to localhost/127.0.0.1:44277] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2106148565-172.31.14.131-1675839761008 (Datanode Uuid 22a52fe2-643c-41fa-9df8-0ffb117ab2d6) service to localhost/127.0.0.1:44277 2023-02-08 07:02:59,012 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/cluster_340e2e30-d8f7-817e-1e6c-e3d23c94ed6c/dfs/data/data3/current/BP-2106148565-172.31.14.131-1675839761008] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:02:59,012 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/cluster_340e2e30-d8f7-817e-1e6c-e3d23c94ed6c/dfs/data/data4/current/BP-2106148565-172.31.14.131-1675839761008] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:02:59,013 WARN [Listener at localhost/32917] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:02:59,016 INFO [Listener at localhost/32917] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:02:59,119 WARN [BP-2106148565-172.31.14.131-1675839761008 heartbeating to localhost/127.0.0.1:44277] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:02:59,119 WARN [BP-2106148565-172.31.14.131-1675839761008 heartbeating to localhost/127.0.0.1:44277] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2106148565-172.31.14.131-1675839761008 (Datanode Uuid efe56570-012e-4404-8f27-996c7cf42783) service to localhost/127.0.0.1:44277 2023-02-08 07:02:59,120 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/cluster_340e2e30-d8f7-817e-1e6c-e3d23c94ed6c/dfs/data/data1/current/BP-2106148565-172.31.14.131-1675839761008] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:02:59,121 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/cluster_340e2e30-d8f7-817e-1e6c-e3d23c94ed6c/dfs/data/data2/current/BP-2106148565-172.31.14.131-1675839761008] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:02:59,154 INFO [Listener at localhost/32917] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:02:59,275 INFO [Listener at localhost/32917] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 07:02:59,356 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 07:02:59,373 INFO [Listener at localhost/32917] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:44277 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:44277 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,40701,1675839764394)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:44277 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/32917 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@3a14d19d java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:44277 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:44277 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:44277 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44277 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=537 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=318 (was 204) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 166), AvailableMemoryMB=4692 (was 5740) 2023-02-08 07:02:59,382 INFO [Listener at localhost/32917] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=537, MaxFileDescriptor=60000, SystemLoadAverage=318, ProcessCount=165, AvailableMemoryMB=4692 2023-02-08 07:02:59,394 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/hadoop.log.dir so I do NOT create it in target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48 2023-02-08 07:02:59,394 WARN [Listener at localhost/32917] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/hadoop.log.dir Erasing configuration value by system value. 2023-02-08 07:02:59,394 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/hadoop.tmp.dir so I do NOT create it in target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48 2023-02-08 07:02:59,394 WARN [Listener at localhost/32917] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/263d6f4b-5401-e561-8f49-440b01975dd8/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-08 07:02:59,394 DEBUG [Listener at localhost/32917] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48 2023-02-08 07:02:59,394 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 07:02:59,394 INFO [Listener at localhost/32917] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/cluster_98ed82c7-d295-0ba7-07a2-91bfd72c9573, deleteOnExit=true 2023-02-08 07:02:59,394 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 07:02:59,394 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/test.cache.data in system properties and HBase conf 2023-02-08 07:02:59,394 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 07:02:59,395 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/hadoop.log.dir in system properties and HBase conf 2023-02-08 07:02:59,395 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 07:02:59,395 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 07:02:59,395 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 07:02:59,395 DEBUG [Listener at localhost/32917] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 07:02:59,395 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:02:59,395 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:02:59,395 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 07:02:59,395 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:02:59,396 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 07:02:59,396 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 07:02:59,396 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:02:59,396 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:02:59,396 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 07:02:59,396 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/nfs.dump.dir in system properties and HBase conf 2023-02-08 07:02:59,396 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/java.io.tmpdir in system properties and HBase conf 2023-02-08 07:02:59,396 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:02:59,396 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 07:02:59,396 INFO [Listener at localhost/32917] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 07:02:59,401 WARN [Listener at localhost/32917] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:02:59,401 WARN [Listener at localhost/32917] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:02:59,445 WARN [Listener at localhost/32917] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:02:59,447 INFO [Listener at localhost/32917] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:02:59,452 INFO [Listener at localhost/32917] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/java.io.tmpdir/Jetty_localhost_34245_hdfs____.lvztpg/webapp 2023-02-08 07:02:59,570 INFO [Listener at localhost/32917] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34245 2023-02-08 07:02:59,574 WARN [Listener at localhost/32917] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:02:59,574 WARN [Listener at localhost/32917] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:02:59,624 WARN [Listener at localhost/39907] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:02:59,647 WARN [Listener at localhost/39907] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:02:59,649 WARN [Listener at localhost/39907] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:02:59,650 INFO [Listener at localhost/39907] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:02:59,656 INFO [Listener at localhost/39907] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/java.io.tmpdir/Jetty_localhost_46743_datanode____hz0tgb/webapp 2023-02-08 07:02:59,747 INFO [Listener at localhost/39907] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46743 2023-02-08 07:02:59,756 WARN [Listener at localhost/39875] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:02:59,778 WARN [Listener at localhost/39875] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:02:59,780 WARN [Listener at localhost/39875] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:02:59,781 INFO [Listener at localhost/39875] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:02:59,786 INFO [Listener at localhost/39875] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/java.io.tmpdir/Jetty_localhost_37661_datanode____q89p84/webapp 2023-02-08 07:02:59,877 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x47def965292bcce5: Processing first storage report for DS-70f5a640-d3e0-4f6e-9f80-76ed8458b5ba from datanode 1bdac5db-144a-4afa-81f1-3bacbba38751 2023-02-08 07:02:59,877 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x47def965292bcce5: from storage DS-70f5a640-d3e0-4f6e-9f80-76ed8458b5ba node DatanodeRegistration(127.0.0.1:41835, datanodeUuid=1bdac5db-144a-4afa-81f1-3bacbba38751, infoPort=43455, infoSecurePort=0, ipcPort=39875, storageInfo=lv=-57;cid=testClusterID;nsid=1081334536;c=1675839779404), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:02:59,877 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x47def965292bcce5: Processing first storage report for DS-aafb6b00-41f9-4716-aa00-48197d106549 from datanode 1bdac5db-144a-4afa-81f1-3bacbba38751 2023-02-08 07:02:59,877 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x47def965292bcce5: from storage DS-aafb6b00-41f9-4716-aa00-48197d106549 node DatanodeRegistration(127.0.0.1:41835, datanodeUuid=1bdac5db-144a-4afa-81f1-3bacbba38751, infoPort=43455, infoSecurePort=0, ipcPort=39875, storageInfo=lv=-57;cid=testClusterID;nsid=1081334536;c=1675839779404), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:02:59,890 INFO [Listener at localhost/39875] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37661 2023-02-08 07:02:59,898 WARN [Listener at localhost/40875] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:00,012 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaf729da6bfee70f8: Processing first storage report for DS-ac844516-90fe-4eec-9321-d8ec2dea025f from datanode ffcaf2ef-1c97-441c-9235-fe4e84b04f70 2023-02-08 07:03:00,013 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaf729da6bfee70f8: from storage DS-ac844516-90fe-4eec-9321-d8ec2dea025f node DatanodeRegistration(127.0.0.1:41045, datanodeUuid=ffcaf2ef-1c97-441c-9235-fe4e84b04f70, infoPort=36975, infoSecurePort=0, ipcPort=40875, storageInfo=lv=-57;cid=testClusterID;nsid=1081334536;c=1675839779404), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-08 07:03:00,013 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaf729da6bfee70f8: Processing first storage report for DS-c6ed6e4d-6006-41ff-9312-1146afe3ed98 from datanode ffcaf2ef-1c97-441c-9235-fe4e84b04f70 2023-02-08 07:03:00,013 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaf729da6bfee70f8: from storage DS-c6ed6e4d-6006-41ff-9312-1146afe3ed98 node DatanodeRegistration(127.0.0.1:41045, datanodeUuid=ffcaf2ef-1c97-441c-9235-fe4e84b04f70, infoPort=36975, infoSecurePort=0, ipcPort=40875, storageInfo=lv=-57;cid=testClusterID;nsid=1081334536;c=1675839779404), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:00,111 DEBUG [Listener at localhost/40875] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48 2023-02-08 07:03:00,120 INFO [Listener at localhost/40875] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/cluster_98ed82c7-d295-0ba7-07a2-91bfd72c9573/zookeeper_0, clientPort=55841, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/cluster_98ed82c7-d295-0ba7-07a2-91bfd72c9573/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/cluster_98ed82c7-d295-0ba7-07a2-91bfd72c9573/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 07:03:00,125 INFO [Listener at localhost/40875] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55841 2023-02-08 07:03:00,125 INFO [Listener at localhost/40875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:00,127 INFO [Listener at localhost/40875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:00,177 INFO [Listener at localhost/40875] util.FSUtils(479): Created version file at hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1 with version=8 2023-02-08 07:03:00,177 INFO [Listener at localhost/40875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:00,179 INFO [Listener at localhost/40875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:00,180 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/hbase-staging 2023-02-08 07:03:00,182 INFO [Listener at localhost/40875] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:00,182 INFO [Listener at localhost/40875] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:00,182 INFO [Listener at localhost/40875] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:00,183 INFO [Listener at localhost/40875] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:00,183 INFO [Listener at localhost/40875] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:00,183 INFO [Listener at localhost/40875] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:00,183 INFO [Listener at localhost/40875] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:00,186 INFO [Listener at localhost/40875] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45251 2023-02-08 07:03:00,187 INFO [Listener at localhost/40875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:00,188 INFO [Listener at localhost/40875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:00,189 INFO [Listener at localhost/40875] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45251 connecting to ZooKeeper ensemble=127.0.0.1:55841 2023-02-08 07:03:00,220 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:452510x0, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:00,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45251-0x10032bd9ed60000 connected 2023-02-08 07:03:00,328 DEBUG [Listener at localhost/40875] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:00,328 DEBUG [Listener at localhost/40875] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:00,329 DEBUG [Listener at localhost/40875] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:00,352 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45251 2023-02-08 07:03:00,352 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45251 2023-02-08 07:03:00,352 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45251 2023-02-08 07:03:00,368 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45251 2023-02-08 07:03:00,376 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45251 2023-02-08 07:03:00,376 INFO [Listener at localhost/40875] master.HMaster(439): hbase.rootdir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1, hbase.cluster.distributed=false 2023-02-08 07:03:00,408 INFO [Listener at localhost/40875] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:00,409 INFO [Listener at localhost/40875] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:00,409 INFO [Listener at localhost/40875] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:00,409 INFO [Listener at localhost/40875] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:00,409 INFO [Listener at localhost/40875] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:00,409 INFO [Listener at localhost/40875] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:00,409 INFO [Listener at localhost/40875] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:00,421 INFO [Listener at localhost/40875] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32893 2023-02-08 07:03:00,422 INFO [Listener at localhost/40875] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:03:00,442 DEBUG [Listener at localhost/40875] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:00,443 INFO [Listener at localhost/40875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:00,445 INFO [Listener at localhost/40875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:00,446 INFO [Listener at localhost/40875] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32893 connecting to ZooKeeper ensemble=127.0.0.1:55841 2023-02-08 07:03:00,450 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:328930x0, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:00,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:32893-0x10032bd9ed60001 connected 2023-02-08 07:03:00,452 DEBUG [Listener at localhost/40875] zookeeper.ZKUtil(164): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:00,453 DEBUG [Listener at localhost/40875] zookeeper.ZKUtil(164): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:00,453 DEBUG [Listener at localhost/40875] zookeeper.ZKUtil(164): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:00,459 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32893 2023-02-08 07:03:00,460 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32893 2023-02-08 07:03:00,462 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32893 2023-02-08 07:03:00,464 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32893 2023-02-08 07:03:00,464 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32893 2023-02-08 07:03:00,480 INFO [Listener at localhost/40875] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:00,480 INFO [Listener at localhost/40875] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:00,480 INFO [Listener at localhost/40875] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:00,481 INFO [Listener at localhost/40875] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:00,481 INFO [Listener at localhost/40875] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:00,481 INFO [Listener at localhost/40875] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:00,481 INFO [Listener at localhost/40875] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:00,483 INFO [Listener at localhost/40875] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35861 2023-02-08 07:03:00,484 INFO [Listener at localhost/40875] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:03:00,488 DEBUG [Listener at localhost/40875] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:00,489 INFO [Listener at localhost/40875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:00,490 INFO [Listener at localhost/40875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:00,492 INFO [Listener at localhost/40875] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35861 connecting to ZooKeeper ensemble=127.0.0.1:55841 2023-02-08 07:03:00,495 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:358610x0, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:00,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35861-0x10032bd9ed60002 connected 2023-02-08 07:03:00,496 DEBUG [Listener at localhost/40875] zookeeper.ZKUtil(164): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:00,497 DEBUG [Listener at localhost/40875] zookeeper.ZKUtil(164): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:00,498 DEBUG [Listener at localhost/40875] zookeeper.ZKUtil(164): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:00,498 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35861 2023-02-08 07:03:00,498 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35861 2023-02-08 07:03:00,500 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35861 2023-02-08 07:03:00,508 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35861 2023-02-08 07:03:00,512 DEBUG [Listener at localhost/40875] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35861 2023-02-08 07:03:00,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45251,1675839780181 2023-02-08 07:03:00,514 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:03:00,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45251,1675839780181 2023-02-08 07:03:00,518 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:00,518 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:00,518 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:00,518 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:00,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:03:00,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45251,1675839780181 from backup master directory 2023-02-08 07:03:00,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:03:00,522 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:00,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,45251,1675839780181 2023-02-08 07:03:00,522 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45251,1675839780181 2023-02-08 07:03:00,522 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:03:00,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/hbase.id with ID: 5a85cecb-2021-4282-96b4-6b7f5812f1b5 2023-02-08 07:03:00,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:00,559 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:00,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5024daaf to 127.0.0.1:55841 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:00,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e44de29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:00,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:00,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 07:03:00,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:00,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/data/master/store-tmp 2023-02-08 07:03:00,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:00,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:03:00,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:00,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:00,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:03:00,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:00,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:00,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839780595Disabling compacts and flushes for region at 1675839780595Disabling writes for close at 1675839780595Writing region close event to WAL at 1675839780595Closed at 1675839780595 2023-02-08 07:03:00,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/WALs/jenkins-hbase4.apache.org,45251,1675839780181 2023-02-08 07:03:00,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45251%2C1675839780181, suffix=, logDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/WALs/jenkins-hbase4.apache.org,45251,1675839780181, archiveDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/oldWALs, maxLogs=10 2023-02-08 07:03:00,618 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41045,DS-ac844516-90fe-4eec-9321-d8ec2dea025f,DISK] 2023-02-08 07:03:00,619 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41835,DS-70f5a640-d3e0-4f6e-9f80-76ed8458b5ba,DISK] 2023-02-08 07:03:00,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/WALs/jenkins-hbase4.apache.org,45251,1675839780181/jenkins-hbase4.apache.org%2C45251%2C1675839780181.1675839780599 2023-02-08 07:03:00,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41045,DS-ac844516-90fe-4eec-9321-d8ec2dea025f,DISK], DatanodeInfoWithStorage[127.0.0.1:41835,DS-70f5a640-d3e0-4f6e-9f80-76ed8458b5ba,DISK]] 2023-02-08 07:03:00,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:00,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:00,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:00,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:00,630 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:00,633 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 07:03:00,633 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 07:03:00,634 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:00,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:00,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:00,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:00,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:00,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75087705, jitterRate=0.11889399588108063}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:03:00,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675839780628Initializing all the Stores at 1675839780629 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839780629Cleaning up temporary data from old regions at 1675839780636 (+7 ms)Cleaning up detritus from prior splits at 1675839780636Region opened successfully at 1675839780640 (+4 ms) 2023-02-08 07:03:00,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 07:03:00,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 07:03:00,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 07:03:00,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 07:03:00,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-08 07:03:00,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-08 07:03:00,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 07:03:00,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 07:03:00,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 07:03:00,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 07:03:00,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 07:03:00,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 07:03:00,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 07:03:00,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 07:03:00,660 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:00,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 07:03:00,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 07:03:00,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 07:03:00,662 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:00,662 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:00,662 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:00,662 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:00,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,45251,1675839780181, sessionid=0x10032bd9ed60000, setting cluster-up flag (Was=false) 2023-02-08 07:03:00,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 07:03:00,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45251,1675839780181 2023-02-08 07:03:00,677 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:00,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 07:03:00,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45251,1675839780181 2023-02-08 07:03:00,681 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.hbase-snapshot/.tmp 2023-02-08 07:03:00,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:00,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:00,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:00,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:00,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:00,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 07:03:00,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:00,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675839810686 2023-02-08 07:03:00,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 07:03:00,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 07:03:00,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 07:03:00,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 07:03:00,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 07:03:00,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 07:03:00,686 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:00,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,686 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 07:03:00,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 07:03:00,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 07:03:00,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 07:03:00,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 07:03:00,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 07:03:00,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839780688,5,FailOnTimeoutGroup] 2023-02-08 07:03:00,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839780688,5,FailOnTimeoutGroup] 2023-02-08 07:03:00,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 07:03:00,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,688 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:00,697 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:00,698 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:00,698 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1 2023-02-08 07:03:00,705 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:00,706 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:03:00,708 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/info 2023-02-08 07:03:00,708 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:03:00,709 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:00,709 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:03:00,710 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:00,711 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:03:00,711 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:00,711 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:03:00,713 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/table 2023-02-08 07:03:00,714 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:03:00,714 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:00,714 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(952): ClusterId : 5a85cecb-2021-4282-96b4-6b7f5812f1b5 2023-02-08 07:03:00,714 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(952): ClusterId : 5a85cecb-2021-4282-96b4-6b7f5812f1b5 2023-02-08 07:03:00,715 DEBUG [RS:0;jenkins-hbase4:32893] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:03:00,715 DEBUG [RS:1;jenkins-hbase4:35861] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:03:00,715 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740 2023-02-08 07:03:00,715 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740 2023-02-08 07:03:00,717 DEBUG [RS:0;jenkins-hbase4:32893] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:03:00,717 DEBUG [RS:1;jenkins-hbase4:35861] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:03:00,718 DEBUG [RS:1;jenkins-hbase4:35861] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:03:00,718 DEBUG [RS:0;jenkins-hbase4:32893] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:03:00,718 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:03:00,719 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:03:00,720 DEBUG [RS:1;jenkins-hbase4:35861] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:03:00,722 DEBUG [RS:0;jenkins-hbase4:32893] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:03:00,722 DEBUG [RS:1;jenkins-hbase4:35861] zookeeper.ReadOnlyZKClient(139): Connect 0x27a46b09 to 127.0.0.1:55841 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:00,737 DEBUG [RS:0;jenkins-hbase4:32893] zookeeper.ReadOnlyZKClient(139): Connect 0x1941983d to 127.0.0.1:55841 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:00,739 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:00,741 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71596224, jitterRate=0.06686687469482422}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:03:00,741 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675839780705Initializing all the Stores at 1675839780706 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839780706Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839780706Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839780706Cleaning up temporary data from old regions at 1675839780716 (+10 ms)Cleaning up detritus from prior splits at 1675839780717 (+1 ms)Region opened successfully at 1675839780741 (+24 ms) 2023-02-08 07:03:00,741 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:03:00,741 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:03:00,742 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:03:00,742 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:03:00,742 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:03:00,742 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:00,742 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839780741Disabling compacts and flushes for region at 1675839780741Disabling writes for close at 1675839780742 (+1 ms)Writing region close event to WAL at 1675839780742Closed at 1675839780742 2023-02-08 07:03:00,743 DEBUG [RS:1;jenkins-hbase4:35861] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2963818d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:00,743 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:00,743 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 07:03:00,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 07:03:00,744 DEBUG [RS:0;jenkins-hbase4:32893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17866565, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:00,744 DEBUG [RS:0;jenkins-hbase4:32893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13b9f34d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:00,745 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 07:03:00,746 DEBUG [RS:1;jenkins-hbase4:35861] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d5c0079, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:00,752 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 07:03:00,756 DEBUG [RS:1;jenkins-hbase4:35861] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35861 2023-02-08 07:03:00,756 INFO [RS:1;jenkins-hbase4:35861] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:03:00,756 INFO [RS:1;jenkins-hbase4:35861] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:03:00,756 DEBUG [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:03:00,756 DEBUG [RS:0;jenkins-hbase4:32893] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:32893 2023-02-08 07:03:00,756 INFO [RS:0;jenkins-hbase4:32893] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:03:00,756 INFO [RS:0;jenkins-hbase4:32893] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:03:00,756 DEBUG [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:03:00,757 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45251,1675839780181 with isa=jenkins-hbase4.apache.org/172.31.14.131:35861, startcode=1675839780480 2023-02-08 07:03:00,757 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45251,1675839780181 with isa=jenkins-hbase4.apache.org/172.31.14.131:32893, startcode=1675839780408 2023-02-08 07:03:00,757 DEBUG [RS:1;jenkins-hbase4:35861] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:03:00,757 DEBUG [RS:0;jenkins-hbase4:32893] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:03:00,762 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40241, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:03:00,762 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52785, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:03:00,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45251] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:00,763 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:00,764 DEBUG [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1 2023-02-08 07:03:00,764 DEBUG [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1 2023-02-08 07:03:00,764 DEBUG [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39907 2023-02-08 07:03:00,764 DEBUG [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39907 2023-02-08 07:03:00,764 DEBUG [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:03:00,764 DEBUG [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:03:00,769 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:00,770 DEBUG [RS:0;jenkins-hbase4:32893] zookeeper.ZKUtil(162): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:00,770 DEBUG [RS:1;jenkins-hbase4:35861] zookeeper.ZKUtil(162): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:00,770 WARN [RS:0;jenkins-hbase4:32893] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:00,770 WARN [RS:1;jenkins-hbase4:35861] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:00,770 INFO [RS:0;jenkins-hbase4:32893] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:00,770 INFO [RS:1;jenkins-hbase4:35861] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:00,770 DEBUG [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/WALs/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:00,770 DEBUG [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/WALs/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:00,770 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35861,1675839780480] 2023-02-08 07:03:00,770 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32893,1675839780408] 2023-02-08 07:03:00,775 DEBUG [RS:1;jenkins-hbase4:35861] zookeeper.ZKUtil(162): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:00,775 DEBUG [RS:0;jenkins-hbase4:32893] zookeeper.ZKUtil(162): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:00,776 DEBUG [RS:0;jenkins-hbase4:32893] zookeeper.ZKUtil(162): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:00,776 DEBUG [RS:1;jenkins-hbase4:35861] zookeeper.ZKUtil(162): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:00,777 DEBUG [RS:0;jenkins-hbase4:32893] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:03:00,777 DEBUG [RS:1;jenkins-hbase4:35861] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:03:00,777 INFO [RS:0;jenkins-hbase4:32893] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:03:00,777 INFO [RS:1;jenkins-hbase4:35861] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:03:00,780 INFO [RS:0;jenkins-hbase4:32893] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:03:00,780 INFO [RS:1;jenkins-hbase4:35861] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:03:00,781 INFO [RS:0;jenkins-hbase4:32893] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:03:00,781 INFO [RS:1;jenkins-hbase4:35861] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:03:00,781 INFO [RS:0;jenkins-hbase4:32893] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,781 INFO [RS:1;jenkins-hbase4:35861] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,781 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:03:00,781 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:03:00,783 INFO [RS:1;jenkins-hbase4:35861] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,783 INFO [RS:0;jenkins-hbase4:32893] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,784 DEBUG [RS:1;jenkins-hbase4:35861] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:0;jenkins-hbase4:32893] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:1;jenkins-hbase4:35861] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:0;jenkins-hbase4:32893] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:1;jenkins-hbase4:35861] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:0;jenkins-hbase4:32893] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:1;jenkins-hbase4:35861] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:0;jenkins-hbase4:32893] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:1;jenkins-hbase4:35861] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:0;jenkins-hbase4:32893] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:1;jenkins-hbase4:35861] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:00,784 DEBUG [RS:0;jenkins-hbase4:32893] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:00,784 DEBUG [RS:1;jenkins-hbase4:35861] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:0;jenkins-hbase4:32893] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:1;jenkins-hbase4:35861] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:0;jenkins-hbase4:32893] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:1;jenkins-hbase4:35861] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:0;jenkins-hbase4:32893] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:1;jenkins-hbase4:35861] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,784 DEBUG [RS:0;jenkins-hbase4:32893] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:00,785 INFO [RS:1;jenkins-hbase4:35861] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,785 INFO [RS:1;jenkins-hbase4:35861] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,785 INFO [RS:1;jenkins-hbase4:35861] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,785 INFO [RS:0;jenkins-hbase4:32893] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,786 INFO [RS:0;jenkins-hbase4:32893] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,786 INFO [RS:0;jenkins-hbase4:32893] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,796 INFO [RS:1;jenkins-hbase4:35861] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:03:00,796 INFO [RS:1;jenkins-hbase4:35861] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35861,1675839780480-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,803 INFO [RS:0;jenkins-hbase4:32893] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:03:00,803 INFO [RS:0;jenkins-hbase4:32893] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32893,1675839780408-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:00,807 INFO [RS:1;jenkins-hbase4:35861] regionserver.Replication(203): jenkins-hbase4.apache.org,35861,1675839780480 started 2023-02-08 07:03:00,807 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35861,1675839780480, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35861, sessionid=0x10032bd9ed60002 2023-02-08 07:03:00,807 DEBUG [RS:1;jenkins-hbase4:35861] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:03:00,807 DEBUG [RS:1;jenkins-hbase4:35861] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:00,807 DEBUG [RS:1;jenkins-hbase4:35861] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35861,1675839780480' 2023-02-08 07:03:00,807 DEBUG [RS:1;jenkins-hbase4:35861] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:00,807 DEBUG [RS:1;jenkins-hbase4:35861] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:00,808 DEBUG [RS:1;jenkins-hbase4:35861] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:03:00,808 DEBUG [RS:1;jenkins-hbase4:35861] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:03:00,808 DEBUG [RS:1;jenkins-hbase4:35861] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:00,808 DEBUG [RS:1;jenkins-hbase4:35861] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35861,1675839780480' 2023-02-08 07:03:00,808 DEBUG [RS:1;jenkins-hbase4:35861] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:00,808 DEBUG [RS:1;jenkins-hbase4:35861] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:00,809 DEBUG [RS:1;jenkins-hbase4:35861] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:03:00,809 INFO [RS:1;jenkins-hbase4:35861] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:03:00,809 INFO [RS:1;jenkins-hbase4:35861] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:03:00,818 INFO [RS:0;jenkins-hbase4:32893] regionserver.Replication(203): jenkins-hbase4.apache.org,32893,1675839780408 started 2023-02-08 07:03:00,819 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,32893,1675839780408, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32893, sessionid=0x10032bd9ed60001 2023-02-08 07:03:00,819 DEBUG [RS:0;jenkins-hbase4:32893] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:03:00,819 DEBUG [RS:0;jenkins-hbase4:32893] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:00,819 DEBUG [RS:0;jenkins-hbase4:32893] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32893,1675839780408' 2023-02-08 07:03:00,819 DEBUG [RS:0;jenkins-hbase4:32893] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:00,819 DEBUG [RS:0;jenkins-hbase4:32893] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:00,820 DEBUG [RS:0;jenkins-hbase4:32893] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:03:00,820 DEBUG [RS:0;jenkins-hbase4:32893] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:03:00,820 DEBUG [RS:0;jenkins-hbase4:32893] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:00,820 DEBUG [RS:0;jenkins-hbase4:32893] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32893,1675839780408' 2023-02-08 07:03:00,820 DEBUG [RS:0;jenkins-hbase4:32893] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:00,820 DEBUG [RS:0;jenkins-hbase4:32893] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:00,821 DEBUG [RS:0;jenkins-hbase4:32893] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:03:00,821 INFO [RS:0;jenkins-hbase4:32893] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:03:00,821 INFO [RS:0;jenkins-hbase4:32893] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:03:00,903 DEBUG [jenkins-hbase4:45251] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 07:03:00,903 DEBUG [jenkins-hbase4:45251] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:00,905 DEBUG [jenkins-hbase4:45251] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:00,905 DEBUG [jenkins-hbase4:45251] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:00,905 DEBUG [jenkins-hbase4:45251] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:00,906 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32893,1675839780408, state=OPENING 2023-02-08 07:03:00,908 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 07:03:00,909 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:00,910 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:03:00,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32893,1675839780408}] 2023-02-08 07:03:01,064 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:01,064 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:03:01,067 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41772, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:03:01,071 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 07:03:01,071 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:01,075 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32893%2C1675839780408.meta, suffix=.meta, logDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/WALs/jenkins-hbase4.apache.org,32893,1675839780408, archiveDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/oldWALs, maxLogs=32 2023-02-08 07:03:01,095 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41835,DS-70f5a640-d3e0-4f6e-9f80-76ed8458b5ba,DISK] 2023-02-08 07:03:01,095 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41045,DS-ac844516-90fe-4eec-9321-d8ec2dea025f,DISK] 2023-02-08 07:03:01,097 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/WALs/jenkins-hbase4.apache.org,32893,1675839780408/jenkins-hbase4.apache.org%2C32893%2C1675839780408.meta.1675839781077.meta 2023-02-08 07:03:01,097 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41835,DS-70f5a640-d3e0-4f6e-9f80-76ed8458b5ba,DISK], DatanodeInfoWithStorage[127.0.0.1:41045,DS-ac844516-90fe-4eec-9321-d8ec2dea025f,DISK]] 2023-02-08 07:03:01,097 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:01,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 07:03:01,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 07:03:01,099 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 07:03:01,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 07:03:01,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:01,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 07:03:01,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 07:03:01,101 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:03:01,102 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/info 2023-02-08 07:03:01,102 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/info 2023-02-08 07:03:01,103 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:03:01,103 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:01,104 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:03:01,104 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:01,105 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:01,105 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:03:01,106 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:01,106 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:03:01,107 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/table 2023-02-08 07:03:01,107 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/table 2023-02-08 07:03:01,107 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:03:01,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:01,108 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740 2023-02-08 07:03:01,110 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740 2023-02-08 07:03:01,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:03:01,113 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:03:01,114 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64744223, jitterRate=-0.035235896706581116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:03:01,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675839781099Writing region info on filesystem at 1675839781099Initializing all the Stores at 1675839781100 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839781100Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839781101 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839781101Cleaning up temporary data from old regions at 1675839781111 (+10 ms)Cleaning up detritus from prior splits at 1675839781111Running coprocessor post-open hooks at 1675839781114 (+3 ms)Region opened successfully at 1675839781114 2023-02-08 07:03:01,115 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675839781064 2023-02-08 07:03:01,120 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 07:03:01,120 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 07:03:01,121 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32893,1675839780408, state=OPEN 2023-02-08 07:03:01,122 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 07:03:01,122 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:03:01,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 07:03:01,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32893,1675839780408 in 212 msec 2023-02-08 07:03:01,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 07:03:01,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 382 msec 2023-02-08 07:03:01,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 446 msec 2023-02-08 07:03:01,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675839780515, completionTime=-1 2023-02-08 07:03:01,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 07:03:01,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 07:03:01,133 DEBUG [hconnection-0x55321fd7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:01,138 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41774, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:01,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 07:03:01,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675839841140 2023-02-08 07:03:01,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675839901140 2023-02-08 07:03:01,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 10 msec 2023-02-08 07:03:01,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45251,1675839780181-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:01,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45251,1675839780181-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:01,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45251,1675839780181-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:01,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45251, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:01,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:01,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 07:03:01,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:01,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 07:03:01,175 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 07:03:01,175 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:03:01,176 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:03:01,178 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2 2023-02-08 07:03:01,179 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2 empty. 2023-02-08 07:03:01,179 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2 2023-02-08 07:03:01,179 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 07:03:01,193 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:01,194 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 25782ea441c1f8abbf9353ed96f175a2, NAME => 'hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp 2023-02-08 07:03:01,211 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:01,211 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 25782ea441c1f8abbf9353ed96f175a2, disabling compactions & flushes 2023-02-08 07:03:01,211 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. 2023-02-08 07:03:01,211 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. 2023-02-08 07:03:01,211 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. after waiting 0 ms 2023-02-08 07:03:01,211 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. 2023-02-08 07:03:01,212 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. 2023-02-08 07:03:01,212 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 25782ea441c1f8abbf9353ed96f175a2: Waiting for close lock at 1675839781211Disabling compacts and flushes for region at 1675839781211Disabling writes for close at 1675839781211Writing region close event to WAL at 1675839781212 (+1 ms)Closed at 1675839781212 2023-02-08 07:03:01,215 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:03:01,216 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839781216"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839781216"}]},"ts":"1675839781216"} 2023-02-08 07:03:01,221 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 07:03:01,222 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:03:01,222 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839781222"}]},"ts":"1675839781222"} 2023-02-08 07:03:01,224 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 07:03:01,227 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:01,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:01,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:01,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:01,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=25782ea441c1f8abbf9353ed96f175a2, ASSIGN}] 2023-02-08 07:03:01,231 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=25782ea441c1f8abbf9353ed96f175a2, ASSIGN 2023-02-08 07:03:01,231 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=25782ea441c1f8abbf9353ed96f175a2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32893,1675839780408; forceNewPlan=false, retain=false 2023-02-08 07:03:01,382 INFO [jenkins-hbase4:45251] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 07:03:01,383 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=25782ea441c1f8abbf9353ed96f175a2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:01,383 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839781383"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839781383"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839781383"}]},"ts":"1675839781383"} 2023-02-08 07:03:01,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 25782ea441c1f8abbf9353ed96f175a2, server=jenkins-hbase4.apache.org,32893,1675839780408}] 2023-02-08 07:03:01,542 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. 2023-02-08 07:03:01,544 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32893%2C1675839780408, suffix=, logDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/WALs/jenkins-hbase4.apache.org,32893,1675839780408, archiveDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/oldWALs, maxLogs=32 2023-02-08 07:03:01,563 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41835,DS-70f5a640-d3e0-4f6e-9f80-76ed8458b5ba,DISK] 2023-02-08 07:03:01,565 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41045,DS-ac844516-90fe-4eec-9321-d8ec2dea025f,DISK] 2023-02-08 07:03:01,567 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/WALs/jenkins-hbase4.apache.org,32893,1675839780408/jenkins-hbase4.apache.org%2C32893%2C1675839780408.1675839781545 2023-02-08 07:03:01,567 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41835,DS-70f5a640-d3e0-4f6e-9f80-76ed8458b5ba,DISK], DatanodeInfoWithStorage[127.0.0.1:41045,DS-ac844516-90fe-4eec-9321-d8ec2dea025f,DISK]] 2023-02-08 07:03:01,567 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 25782ea441c1f8abbf9353ed96f175a2, NAME => 'hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:01,568 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 25782ea441c1f8abbf9353ed96f175a2 2023-02-08 07:03:01,568 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:01,568 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 25782ea441c1f8abbf9353ed96f175a2 2023-02-08 07:03:01,568 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 25782ea441c1f8abbf9353ed96f175a2 2023-02-08 07:03:01,569 INFO [StoreOpener-25782ea441c1f8abbf9353ed96f175a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 25782ea441c1f8abbf9353ed96f175a2 2023-02-08 07:03:01,571 DEBUG [StoreOpener-25782ea441c1f8abbf9353ed96f175a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2/info 2023-02-08 07:03:01,571 DEBUG [StoreOpener-25782ea441c1f8abbf9353ed96f175a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2/info 2023-02-08 07:03:01,571 INFO [StoreOpener-25782ea441c1f8abbf9353ed96f175a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25782ea441c1f8abbf9353ed96f175a2 columnFamilyName info 2023-02-08 07:03:01,572 INFO [StoreOpener-25782ea441c1f8abbf9353ed96f175a2-1] regionserver.HStore(310): Store=25782ea441c1f8abbf9353ed96f175a2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:01,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2 2023-02-08 07:03:01,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2 2023-02-08 07:03:01,576 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 25782ea441c1f8abbf9353ed96f175a2 2023-02-08 07:03:01,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:01,579 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 25782ea441c1f8abbf9353ed96f175a2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74385074, jitterRate=0.10842397809028625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:03:01,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 25782ea441c1f8abbf9353ed96f175a2: Running coprocessor pre-open hook at 1675839781568Writing region info on filesystem at 1675839781568Initializing all the Stores at 1675839781569 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839781569Cleaning up temporary data from old regions at 1675839781574 (+5 ms)Cleaning up detritus from prior splits at 1675839781574Running coprocessor post-open hooks at 1675839781579 (+5 ms)Region opened successfully at 1675839781579 2023-02-08 07:03:01,581 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2., pid=6, masterSystemTime=1675839781538 2023-02-08 07:03:01,585 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. 2023-02-08 07:03:01,585 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. 2023-02-08 07:03:01,586 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=25782ea441c1f8abbf9353ed96f175a2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:01,587 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839781586"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839781586"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839781586"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839781586"}]},"ts":"1675839781586"} 2023-02-08 07:03:01,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 07:03:01,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 25782ea441c1f8abbf9353ed96f175a2, server=jenkins-hbase4.apache.org,32893,1675839780408 in 203 msec 2023-02-08 07:03:01,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 07:03:01,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=25782ea441c1f8abbf9353ed96f175a2, ASSIGN in 363 msec 2023-02-08 07:03:01,594 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:03:01,594 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839781594"}]},"ts":"1675839781594"} 2023-02-08 07:03:01,596 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 07:03:01,599 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:03:01,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 427 msec 2023-02-08 07:03:01,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 07:03:01,676 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:01,676 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:01,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 07:03:01,692 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:01,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-08 07:03:01,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 07:03:01,713 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:01,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-08 07:03:01,728 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 07:03:01,731 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 07:03:01,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.209sec 2023-02-08 07:03:01,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 07:03:01,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 07:03:01,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 07:03:01,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45251,1675839780181-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 07:03:01,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45251,1675839780181-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 07:03:01,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 07:03:01,811 INFO [RS:1;jenkins-hbase4:35861] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35861%2C1675839780480, suffix=, logDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/WALs/jenkins-hbase4.apache.org,35861,1675839780480, archiveDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/oldWALs, maxLogs=32 2023-02-08 07:03:01,814 DEBUG [Listener at localhost/40875] zookeeper.ReadOnlyZKClient(139): Connect 0x539bc584 to 127.0.0.1:55841 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:01,821 DEBUG [Listener at localhost/40875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e13a120, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:01,823 DEBUG [hconnection-0x5f08c7d5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:01,828 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41788, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:01,831 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45251,1675839780181 2023-02-08 07:03:01,831 DEBUG [Listener at localhost/40875] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 07:03:01,831 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:01,831 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:01,838 DEBUG [Listener at localhost/40875] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 07:03:01,844 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41835,DS-70f5a640-d3e0-4f6e-9f80-76ed8458b5ba,DISK] 2023-02-08 07:03:01,845 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41045,DS-ac844516-90fe-4eec-9321-d8ec2dea025f,DISK] 2023-02-08 07:03:01,846 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49726, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 07:03:01,846 INFO [Listener at localhost/40875] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-08 07:03:01,847 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-08 07:03:01,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 07:03:01,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:49726 deadline: 1675839841847, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-08 07:03:01,848 INFO [RS:1;jenkins-hbase4:35861] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/WALs/jenkins-hbase4.apache.org,35861,1675839780480/jenkins-hbase4.apache.org%2C35861%2C1675839780480.1675839781812 2023-02-08 07:03:01,848 DEBUG [RS:1;jenkins-hbase4:35861] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41835,DS-70f5a640-d3e0-4f6e-9f80-76ed8458b5ba,DISK], DatanodeInfoWithStorage[127.0.0.1:41045,DS-ac844516-90fe-4eec-9321-d8ec2dea025f,DISK]] 2023-02-08 07:03:01,848 INFO [Listener at localhost/40875] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-08 07:03:01,848 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:01,848 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:01,851 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:01,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-08 07:03:01,856 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:03:01,857 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-08 07:03:01,857 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:01,857 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:01,857 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:03:01,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:01,867 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:01,867 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:01,867 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:01,867 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:01,867 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:01,868 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77 empty. 2023-02-08 07:03:01,867 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:01,868 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b empty. 2023-02-08 07:03:01,867 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:01,868 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029 empty. 2023-02-08 07:03:01,867 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:01,868 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102 empty. 2023-02-08 07:03:01,869 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:01,869 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4 empty. 2023-02-08 07:03:01,869 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f empty. 2023-02-08 07:03:01,869 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:01,869 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:01,869 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425 empty. 2023-02-08 07:03:01,870 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:01,869 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:01,869 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a empty. 2023-02-08 07:03:01,869 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:01,869 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b empty. 2023-02-08 07:03:01,870 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:01,870 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:01,870 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:01,870 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c empty. 2023-02-08 07:03:01,870 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:01,870 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:01,871 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:01,871 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-08 07:03:01,887 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:01,939 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => acd414963aca9bf4723dc883c453251f, NAME => 'testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp 2023-02-08 07:03:01,939 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6c88256eab2776d728497dd2d0c75425, NAME => 'testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp 2023-02-08 07:03:01,939 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2086f18794bfb36e11dcdc9164e33d77, NAME => 'testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp 2023-02-08 07:03:01,959 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:01,959 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:01,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:01,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:01,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 6c88256eab2776d728497dd2d0c75425, disabling compactions & flushes 2023-02-08 07:03:01,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing acd414963aca9bf4723dc883c453251f, disabling compactions & flushes 2023-02-08 07:03:01,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:01,961 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:01,961 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:01,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:01,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. after waiting 0 ms 2023-02-08 07:03:01,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:01,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:01,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. after waiting 0 ms 2023-02-08 07:03:01,961 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:01,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:01,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 6c88256eab2776d728497dd2d0c75425: Waiting for close lock at 1675839781960Disabling compacts and flushes for region at 1675839781960Disabling writes for close at 1675839781961 (+1 ms)Writing region close event to WAL at 1675839781961Closed at 1675839781961 2023-02-08 07:03:01,961 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:01,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for acd414963aca9bf4723dc883c453251f: Waiting for close lock at 1675839781961Disabling compacts and flushes for region at 1675839781961Disabling writes for close at 1675839781961Writing region close event to WAL at 1675839781961Closed at 1675839781961 2023-02-08 07:03:01,962 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => c2f1e88c1e2851f70723fd0a9ceb68e4, NAME => 'testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp 2023-02-08 07:03:01,962 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => fb95ce31ec826d80712436cd5be5b26b, NAME => 'testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp 2023-02-08 07:03:01,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:01,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 2086f18794bfb36e11dcdc9164e33d77, disabling compactions & flushes 2023-02-08 07:03:01,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:01,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:01,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. after waiting 0 ms 2023-02-08 07:03:01,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:01,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:01,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 2086f18794bfb36e11dcdc9164e33d77: Waiting for close lock at 1675839781965Disabling compacts and flushes for region at 1675839781965Disabling writes for close at 1675839781965Writing region close event to WAL at 1675839781965Closed at 1675839781965 2023-02-08 07:03:01,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2604496a73cb471eea80d0b0607a018b, NAME => 'testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp 2023-02-08 07:03:01,989 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:01,989 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:01,989 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing c2f1e88c1e2851f70723fd0a9ceb68e4, disabling compactions & flushes 2023-02-08 07:03:01,989 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing fb95ce31ec826d80712436cd5be5b26b, disabling compactions & flushes 2023-02-08 07:03:01,989 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:01,989 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:01,989 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. after waiting 0 ms 2023-02-08 07:03:01,989 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:01,989 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:01,989 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:01,989 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:01,989 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for c2f1e88c1e2851f70723fd0a9ceb68e4: Waiting for close lock at 1675839781989Disabling compacts and flushes for region at 1675839781989Disabling writes for close at 1675839781989Writing region close event to WAL at 1675839781989Closed at 1675839781989 2023-02-08 07:03:01,989 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. after waiting 0 ms 2023-02-08 07:03:01,989 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:01,989 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:01,990 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for fb95ce31ec826d80712436cd5be5b26b: Waiting for close lock at 1675839781989Disabling compacts and flushes for region at 1675839781989Disabling writes for close at 1675839781989Writing region close event to WAL at 1675839781989Closed at 1675839781989 2023-02-08 07:03:01,990 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5a37be146e33fe5a01ef9b4ee5891029, NAME => 'testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp 2023-02-08 07:03:01,990 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8e93d330f68b1c19592f63757c725102, NAME => 'testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp 2023-02-08 07:03:02,020 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,020 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 5a37be146e33fe5a01ef9b4ee5891029, disabling compactions & flushes 2023-02-08 07:03:02,020 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:02,020 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:02,020 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. after waiting 0 ms 2023-02-08 07:03:02,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:02,021 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:02,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 5a37be146e33fe5a01ef9b4ee5891029: Waiting for close lock at 1675839782020Disabling compacts and flushes for region at 1675839782020Disabling writes for close at 1675839782021 (+1 ms)Writing region close event to WAL at 1675839782021Closed at 1675839782021 2023-02-08 07:03:02,021 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 87ed579046f8447473797d6e7dbb9f5a, NAME => 'testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp 2023-02-08 07:03:02,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 8e93d330f68b1c19592f63757c725102, disabling compactions & flushes 2023-02-08 07:03:02,024 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:02,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:02,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. after waiting 0 ms 2023-02-08 07:03:02,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:02,025 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:02,025 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 8e93d330f68b1c19592f63757c725102: Waiting for close lock at 1675839782024Disabling compacts and flushes for region at 1675839782024Disabling writes for close at 1675839782024Writing region close event to WAL at 1675839782025 (+1 ms)Closed at 1675839782025 2023-02-08 07:03:02,025 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4fc7d21cab2b5376dc37cc4929bd3e2c, NAME => 'testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.tmp 2023-02-08 07:03:02,030 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,030 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 87ed579046f8447473797d6e7dbb9f5a, disabling compactions & flushes 2023-02-08 07:03:02,030 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:02,030 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:02,030 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. after waiting 0 ms 2023-02-08 07:03:02,030 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:02,031 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:02,031 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 87ed579046f8447473797d6e7dbb9f5a: Waiting for close lock at 1675839782030Disabling compacts and flushes for region at 1675839782030Disabling writes for close at 1675839782030Writing region close event to WAL at 1675839782031 (+1 ms)Closed at 1675839782031 2023-02-08 07:03:02,034 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,034 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4fc7d21cab2b5376dc37cc4929bd3e2c, disabling compactions & flushes 2023-02-08 07:03:02,034 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:02,034 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:02,034 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. after waiting 0 ms 2023-02-08 07:03:02,034 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:02,034 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:02,035 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4fc7d21cab2b5376dc37cc4929bd3e2c: Waiting for close lock at 1675839782034Disabling compacts and flushes for region at 1675839782034Disabling writes for close at 1675839782034Writing region close event to WAL at 1675839782034Closed at 1675839782034 2023-02-08 07:03:02,161 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:02,161 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:02,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:02,390 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,390 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 2604496a73cb471eea80d0b0607a018b, disabling compactions & flushes 2023-02-08 07:03:02,390 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:02,390 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:02,390 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. after waiting 0 ms 2023-02-08 07:03:02,390 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:02,390 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:02,390 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 2604496a73cb471eea80d0b0607a018b: Waiting for close lock at 1675839782390Disabling compacts and flushes for region at 1675839782390Disabling writes for close at 1675839782390Writing region close event to WAL at 1675839782390Closed at 1675839782390 2023-02-08 07:03:02,393 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:03:02,394 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839782394"}]},"ts":"1675839782394"} 2023-02-08 07:03:02,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675839781850.acd414963aca9bf4723dc883c453251f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839782394"}]},"ts":"1675839782394"} 2023-02-08 07:03:02,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839782394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839782394"}]},"ts":"1675839782394"} 2023-02-08 07:03:02,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839782394"}]},"ts":"1675839782394"} 2023-02-08 07:03:02,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839782394"}]},"ts":"1675839782394"} 2023-02-08 07:03:02,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839782394"}]},"ts":"1675839782394"} 2023-02-08 07:03:02,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839782394"}]},"ts":"1675839782394"} 2023-02-08 07:03:02,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839782394"}]},"ts":"1675839782394"} 2023-02-08 07:03:02,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839782394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839782394"}]},"ts":"1675839782394"} 2023-02-08 07:03:02,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675839781850.2604496a73cb471eea80d0b0607a018b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839782394"}]},"ts":"1675839782394"} 2023-02-08 07:03:02,403 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-08 07:03:02,410 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:03:02,411 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839782410"}]},"ts":"1675839782410"} 2023-02-08 07:03:02,413 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-08 07:03:02,416 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:02,424 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:02,424 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:02,424 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:02,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2086f18794bfb36e11dcdc9164e33d77, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6c88256eab2776d728497dd2d0c75425, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=acd414963aca9bf4723dc883c453251f, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c2f1e88c1e2851f70723fd0a9ceb68e4, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fb95ce31ec826d80712436cd5be5b26b, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2604496a73cb471eea80d0b0607a018b, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5a37be146e33fe5a01ef9b4ee5891029, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8e93d330f68b1c19592f63757c725102, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=87ed579046f8447473797d6e7dbb9f5a, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4fc7d21cab2b5376dc37cc4929bd3e2c, ASSIGN}] 2023-02-08 07:03:02,427 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2604496a73cb471eea80d0b0607a018b, ASSIGN 2023-02-08 07:03:02,427 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fb95ce31ec826d80712436cd5be5b26b, ASSIGN 2023-02-08 07:03:02,428 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c2f1e88c1e2851f70723fd0a9ceb68e4, ASSIGN 2023-02-08 07:03:02,428 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5a37be146e33fe5a01ef9b4ee5891029, ASSIGN 2023-02-08 07:03:02,428 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2604496a73cb471eea80d0b0607a018b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35861,1675839780480; forceNewPlan=false, retain=false 2023-02-08 07:03:02,428 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fb95ce31ec826d80712436cd5be5b26b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32893,1675839780408; forceNewPlan=false, retain=false 2023-02-08 07:03:02,428 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c2f1e88c1e2851f70723fd0a9ceb68e4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35861,1675839780480; forceNewPlan=false, retain=false 2023-02-08 07:03:02,429 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5a37be146e33fe5a01ef9b4ee5891029, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35861,1675839780480; forceNewPlan=false, retain=false 2023-02-08 07:03:02,429 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4fc7d21cab2b5376dc37cc4929bd3e2c, ASSIGN 2023-02-08 07:03:02,429 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=87ed579046f8447473797d6e7dbb9f5a, ASSIGN 2023-02-08 07:03:02,430 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8e93d330f68b1c19592f63757c725102, ASSIGN 2023-02-08 07:03:02,430 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=acd414963aca9bf4723dc883c453251f, ASSIGN 2023-02-08 07:03:02,430 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6c88256eab2776d728497dd2d0c75425, ASSIGN 2023-02-08 07:03:02,430 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4fc7d21cab2b5376dc37cc4929bd3e2c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32893,1675839780408; forceNewPlan=false, retain=false 2023-02-08 07:03:02,430 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=87ed579046f8447473797d6e7dbb9f5a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35861,1675839780480; forceNewPlan=false, retain=false 2023-02-08 07:03:02,431 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8e93d330f68b1c19592f63757c725102, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32893,1675839780408; forceNewPlan=false, retain=false 2023-02-08 07:03:02,431 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=acd414963aca9bf4723dc883c453251f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35861,1675839780480; forceNewPlan=false, retain=false 2023-02-08 07:03:02,431 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6c88256eab2776d728497dd2d0c75425, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32893,1675839780408; forceNewPlan=false, retain=false 2023-02-08 07:03:02,431 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2086f18794bfb36e11dcdc9164e33d77, ASSIGN 2023-02-08 07:03:02,432 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2086f18794bfb36e11dcdc9164e33d77, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32893,1675839780408; forceNewPlan=false, retain=false 2023-02-08 07:03:02,464 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:02,465 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:02,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:02,578 INFO [jenkins-hbase4:45251] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-08 07:03:02,583 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=acd414963aca9bf4723dc883c453251f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:02,583 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=5a37be146e33fe5a01ef9b4ee5891029, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:02,583 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2604496a73cb471eea80d0b0607a018b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:02,583 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=87ed579046f8447473797d6e7dbb9f5a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:02,583 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c2f1e88c1e2851f70723fd0a9ceb68e4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:02,584 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675839781850.2604496a73cb471eea80d0b0607a018b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839782583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839782583"}]},"ts":"1675839782583"} 2023-02-08 07:03:02,584 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839782583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839782583"}]},"ts":"1675839782583"} 2023-02-08 07:03:02,584 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839782583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839782583"}]},"ts":"1675839782583"} 2023-02-08 07:03:02,584 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675839781850.acd414963aca9bf4723dc883c453251f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839782583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839782583"}]},"ts":"1675839782583"} 2023-02-08 07:03:02,584 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839782583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839782583"}]},"ts":"1675839782583"} 2023-02-08 07:03:02,586 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure 2604496a73cb471eea80d0b0607a018b, server=jenkins-hbase4.apache.org,35861,1675839780480}] 2023-02-08 07:03:02,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure c2f1e88c1e2851f70723fd0a9ceb68e4, server=jenkins-hbase4.apache.org,35861,1675839780480}] 2023-02-08 07:03:02,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=17, state=RUNNABLE; OpenRegionProcedure 5a37be146e33fe5a01ef9b4ee5891029, server=jenkins-hbase4.apache.org,35861,1675839780480}] 2023-02-08 07:03:02,589 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=13, state=RUNNABLE; OpenRegionProcedure acd414963aca9bf4723dc883c453251f, server=jenkins-hbase4.apache.org,35861,1675839780480}] 2023-02-08 07:03:02,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure 87ed579046f8447473797d6e7dbb9f5a, server=jenkins-hbase4.apache.org,35861,1675839780480}] 2023-02-08 07:03:02,592 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4fc7d21cab2b5376dc37cc4929bd3e2c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:02,593 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839782592"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839782592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839782592"}]},"ts":"1675839782592"} 2023-02-08 07:03:02,594 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=fb95ce31ec826d80712436cd5be5b26b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:02,594 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839782594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839782594"}]},"ts":"1675839782594"} 2023-02-08 07:03:02,595 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=8e93d330f68b1c19592f63757c725102, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:02,595 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839782595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839782595"}]},"ts":"1675839782595"} 2023-02-08 07:03:02,596 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=6c88256eab2776d728497dd2d0c75425, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:02,596 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839782595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839782595"}]},"ts":"1675839782595"} 2023-02-08 07:03:02,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure 4fc7d21cab2b5376dc37cc4929bd3e2c, server=jenkins-hbase4.apache.org,32893,1675839780408}] 2023-02-08 07:03:02,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=15, state=RUNNABLE; OpenRegionProcedure fb95ce31ec826d80712436cd5be5b26b, server=jenkins-hbase4.apache.org,32893,1675839780408}] 2023-02-08 07:03:02,600 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 8e93d330f68b1c19592f63757c725102, server=jenkins-hbase4.apache.org,32893,1675839780408}] 2023-02-08 07:03:02,601 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2086f18794bfb36e11dcdc9164e33d77, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:02,601 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839782601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839782601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839782601"}]},"ts":"1675839782601"} 2023-02-08 07:03:02,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure 6c88256eab2776d728497dd2d0c75425, server=jenkins-hbase4.apache.org,32893,1675839780408}] 2023-02-08 07:03:02,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure 2086f18794bfb36e11dcdc9164e33d77, server=jenkins-hbase4.apache.org,32893,1675839780408}] 2023-02-08 07:03:02,739 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:02,740 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:03:02,742 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46418, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:03:02,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:02,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => acd414963aca9bf4723dc883c453251f, NAME => 'testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-08 07:03:02,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:02,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:02,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:02,748 INFO [StoreOpener-acd414963aca9bf4723dc883c453251f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:02,749 DEBUG [StoreOpener-acd414963aca9bf4723dc883c453251f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f1 2023-02-08 07:03:02,749 DEBUG [StoreOpener-acd414963aca9bf4723dc883c453251f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f1 2023-02-08 07:03:02,749 INFO [StoreOpener-acd414963aca9bf4723dc883c453251f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acd414963aca9bf4723dc883c453251f columnFamilyName f1 2023-02-08 07:03:02,750 INFO [StoreOpener-acd414963aca9bf4723dc883c453251f-1] regionserver.HStore(310): Store=acd414963aca9bf4723dc883c453251f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,750 INFO [StoreOpener-acd414963aca9bf4723dc883c453251f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:02,751 DEBUG [StoreOpener-acd414963aca9bf4723dc883c453251f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f2 2023-02-08 07:03:02,751 DEBUG [StoreOpener-acd414963aca9bf4723dc883c453251f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f2 2023-02-08 07:03:02,752 INFO [StoreOpener-acd414963aca9bf4723dc883c453251f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acd414963aca9bf4723dc883c453251f columnFamilyName f2 2023-02-08 07:03:02,752 INFO [StoreOpener-acd414963aca9bf4723dc883c453251f-1] regionserver.HStore(310): Store=acd414963aca9bf4723dc883c453251f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:02,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:02,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:02,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6c88256eab2776d728497dd2d0c75425, NAME => 'testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-08 07:03:02,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:02,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:02,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:02,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:02,756 INFO [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:02,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:02,757 DEBUG [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f1 2023-02-08 07:03:02,757 DEBUG [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f1 2023-02-08 07:03:02,758 INFO [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c88256eab2776d728497dd2d0c75425 columnFamilyName f1 2023-02-08 07:03:02,758 INFO [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] regionserver.HStore(310): Store=6c88256eab2776d728497dd2d0c75425/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,759 INFO [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:02,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:02,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened acd414963aca9bf4723dc883c453251f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59007986, jitterRate=-0.12071248888969421}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:02,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for acd414963aca9bf4723dc883c453251f: Running coprocessor pre-open hook at 1675839782747Writing region info on filesystem at 1675839782747Initializing all the Stores at 1675839782748 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782748Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782748Cleaning up temporary data from old regions at 1675839782754 (+6 ms)Cleaning up detritus from prior splits at 1675839782754Running coprocessor post-open hooks at 1675839782759 (+5 ms)Region opened successfully at 1675839782759 2023-02-08 07:03:02,760 DEBUG [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f2 2023-02-08 07:03:02,760 DEBUG [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f2 2023-02-08 07:03:02,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f., pid=24, masterSystemTime=1675839782739 2023-02-08 07:03:02,760 INFO [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c88256eab2776d728497dd2d0c75425 columnFamilyName f2 2023-02-08 07:03:02,763 INFO [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] regionserver.HStore(310): Store=6c88256eab2776d728497dd2d0c75425/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:02,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:02,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:02,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:02,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:02,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c2f1e88c1e2851f70723fd0a9ceb68e4, NAME => 'testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-08 07:03:02,765 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=acd414963aca9bf4723dc883c453251f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:02,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:02,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,765 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675839781850.acd414963aca9bf4723dc883c453251f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782765"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839782765"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839782765"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839782765"}]},"ts":"1675839782765"} 2023-02-08 07:03:02,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:02,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:02,767 INFO [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:02,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:02,768 DEBUG [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f1 2023-02-08 07:03:02,768 DEBUG [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f1 2023-02-08 07:03:02,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:02,769 INFO [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2f1e88c1e2851f70723fd0a9ceb68e4 columnFamilyName f1 2023-02-08 07:03:02,769 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=13 2023-02-08 07:03:02,769 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=13, state=SUCCESS; OpenRegionProcedure acd414963aca9bf4723dc883c453251f, server=jenkins-hbase4.apache.org,35861,1675839780480 in 178 msec 2023-02-08 07:03:02,769 INFO [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] regionserver.HStore(310): Store=c2f1e88c1e2851f70723fd0a9ceb68e4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,769 INFO [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:02,771 DEBUG [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f2 2023-02-08 07:03:02,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:02,771 DEBUG [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f2 2023-02-08 07:03:02,771 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=acd414963aca9bf4723dc883c453251f, ASSIGN in 344 msec 2023-02-08 07:03:02,771 INFO [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2f1e88c1e2851f70723fd0a9ceb68e4 columnFamilyName f2 2023-02-08 07:03:02,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6c88256eab2776d728497dd2d0c75425; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64321125, jitterRate=-0.04154054820537567}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:02,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6c88256eab2776d728497dd2d0c75425: Running coprocessor pre-open hook at 1675839782755Writing region info on filesystem at 1675839782755Initializing all the Stores at 1675839782756 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782756Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782756Cleaning up temporary data from old regions at 1675839782765 (+9 ms)Cleaning up detritus from prior splits at 1675839782766 (+1 ms)Running coprocessor post-open hooks at 1675839782771 (+5 ms)Region opened successfully at 1675839782771 2023-02-08 07:03:02,772 INFO [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] regionserver.HStore(310): Store=c2f1e88c1e2851f70723fd0a9ceb68e4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425., pid=29, masterSystemTime=1675839782751 2023-02-08 07:03:02,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:02,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:02,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:02,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:02,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:02,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4fc7d21cab2b5376dc37cc4929bd3e2c, NAME => 'testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-08 07:03:02,774 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=6c88256eab2776d728497dd2d0c75425, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:02,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:02,774 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782774"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839782774"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839782774"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839782774"}]},"ts":"1675839782774"} 2023-02-08 07:03:02,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:02,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:02,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:02,776 INFO [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:02,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:02,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-08 07:03:02,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure 6c88256eab2776d728497dd2d0c75425, server=jenkins-hbase4.apache.org,32893,1675839780408 in 175 msec 2023-02-08 07:03:02,778 DEBUG [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c/f1 2023-02-08 07:03:02,778 DEBUG [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c/f1 2023-02-08 07:03:02,778 INFO [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fc7d21cab2b5376dc37cc4929bd3e2c columnFamilyName f1 2023-02-08 07:03:02,779 INFO [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] regionserver.HStore(310): Store=4fc7d21cab2b5376dc37cc4929bd3e2c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,779 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6c88256eab2776d728497dd2d0c75425, ASSIGN in 353 msec 2023-02-08 07:03:02,779 INFO [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:02,781 DEBUG [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c/f2 2023-02-08 07:03:02,781 DEBUG [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c/f2 2023-02-08 07:03:02,781 INFO [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fc7d21cab2b5376dc37cc4929bd3e2c columnFamilyName f2 2023-02-08 07:03:02,782 INFO [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] regionserver.HStore(310): Store=4fc7d21cab2b5376dc37cc4929bd3e2c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:02,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:02,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:02,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c2f1e88c1e2851f70723fd0a9ceb68e4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62270371, jitterRate=-0.07209916412830353}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:02,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c2f1e88c1e2851f70723fd0a9ceb68e4: Running coprocessor pre-open hook at 1675839782765Writing region info on filesystem at 1675839782765Initializing all the Stores at 1675839782766 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782766Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782766Cleaning up temporary data from old regions at 1675839782774 (+8 ms)Cleaning up detritus from prior splits at 1675839782774Running coprocessor post-open hooks at 1675839782784 (+10 ms)Region opened successfully at 1675839782784 2023-02-08 07:03:02,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4., pid=22, masterSystemTime=1675839782739 2023-02-08 07:03:02,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:02,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:02,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:02,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:02,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 87ed579046f8447473797d6e7dbb9f5a, NAME => 'testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-08 07:03:02,787 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c2f1e88c1e2851f70723fd0a9ceb68e4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:02,787 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782786"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839782786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839782786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839782786"}]},"ts":"1675839782786"} 2023-02-08 07:03:02,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:02,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:02,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:02,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:02,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-08 07:03:02,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure c2f1e88c1e2851f70723fd0a9ceb68e4, server=jenkins-hbase4.apache.org,35861,1675839780480 in 202 msec 2023-02-08 07:03:02,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c2f1e88c1e2851f70723fd0a9ceb68e4, ASSIGN in 366 msec 2023-02-08 07:03:02,796 INFO [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:02,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:02,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4fc7d21cab2b5376dc37cc4929bd3e2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59811777, jitterRate=-0.10873506963253021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:02,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4fc7d21cab2b5376dc37cc4929bd3e2c: Running coprocessor pre-open hook at 1675839782775Writing region info on filesystem at 1675839782775Initializing all the Stores at 1675839782776 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782776Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782776Cleaning up temporary data from old regions at 1675839782784 (+8 ms)Cleaning up detritus from prior splits at 1675839782785 (+1 ms)Running coprocessor post-open hooks at 1675839782797 (+12 ms)Region opened successfully at 1675839782797 2023-02-08 07:03:02,797 DEBUG [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f1 2023-02-08 07:03:02,797 DEBUG [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f1 2023-02-08 07:03:02,798 INFO [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ed579046f8447473797d6e7dbb9f5a columnFamilyName f1 2023-02-08 07:03:02,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c., pid=26, masterSystemTime=1675839782751 2023-02-08 07:03:02,798 INFO [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] regionserver.HStore(310): Store=87ed579046f8447473797d6e7dbb9f5a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,798 INFO [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:02,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:02,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:02,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:02,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8e93d330f68b1c19592f63757c725102, NAME => 'testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-08 07:03:02,800 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4fc7d21cab2b5376dc37cc4929bd3e2c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:02,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:02,800 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839782800"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839782800"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839782800"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839782800"}]},"ts":"1675839782800"} 2023-02-08 07:03:02,800 DEBUG [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f2 2023-02-08 07:03:02,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,800 DEBUG [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f2 2023-02-08 07:03:02,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:02,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:02,801 INFO [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ed579046f8447473797d6e7dbb9f5a columnFamilyName f2 2023-02-08 07:03:02,803 INFO [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] regionserver.HStore(310): Store=87ed579046f8447473797d6e7dbb9f5a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-08 07:03:02,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure 4fc7d21cab2b5376dc37cc4929bd3e2c, server=jenkins-hbase4.apache.org,32893,1675839780408 in 206 msec 2023-02-08 07:03:02,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:02,804 INFO [StoreOpener-8e93d330f68b1c19592f63757c725102-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:02,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:02,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4fc7d21cab2b5376dc37cc4929bd3e2c, ASSIGN in 378 msec 2023-02-08 07:03:02,805 DEBUG [StoreOpener-8e93d330f68b1c19592f63757c725102-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f1 2023-02-08 07:03:02,806 DEBUG [StoreOpener-8e93d330f68b1c19592f63757c725102-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f1 2023-02-08 07:03:02,806 INFO [StoreOpener-8e93d330f68b1c19592f63757c725102-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e93d330f68b1c19592f63757c725102 columnFamilyName f1 2023-02-08 07:03:02,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:02,807 INFO [StoreOpener-8e93d330f68b1c19592f63757c725102-1] regionserver.HStore(310): Store=8e93d330f68b1c19592f63757c725102/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,807 INFO [StoreOpener-8e93d330f68b1c19592f63757c725102-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:02,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:02,808 DEBUG [StoreOpener-8e93d330f68b1c19592f63757c725102-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f2 2023-02-08 07:03:02,808 DEBUG [StoreOpener-8e93d330f68b1c19592f63757c725102-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f2 2023-02-08 07:03:02,809 INFO [StoreOpener-8e93d330f68b1c19592f63757c725102-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e93d330f68b1c19592f63757c725102 columnFamilyName f2 2023-02-08 07:03:02,810 INFO [StoreOpener-8e93d330f68b1c19592f63757c725102-1] regionserver.HStore(310): Store=8e93d330f68b1c19592f63757c725102/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:02,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:02,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 87ed579046f8447473797d6e7dbb9f5a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59884647, jitterRate=-0.10764922201633453}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:02,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:02,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 87ed579046f8447473797d6e7dbb9f5a: Running coprocessor pre-open hook at 1675839782787Writing region info on filesystem at 1675839782787Initializing all the Stores at 1675839782789 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782789Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782796 (+7 ms)Cleaning up temporary data from old regions at 1675839782805 (+9 ms)Cleaning up detritus from prior splits at 1675839782806 (+1 ms)Running coprocessor post-open hooks at 1675839782813 (+7 ms)Region opened successfully at 1675839782813 2023-02-08 07:03:02,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a., pid=25, masterSystemTime=1675839782739 2023-02-08 07:03:02,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:02,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:02,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:02,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:02,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2604496a73cb471eea80d0b0607a018b, NAME => 'testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-08 07:03:02,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:02,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:02,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:02,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:02,817 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=87ed579046f8447473797d6e7dbb9f5a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:02,818 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782817"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839782817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839782817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839782817"}]},"ts":"1675839782817"} 2023-02-08 07:03:02,820 INFO [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:02,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:02,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8e93d330f68b1c19592f63757c725102; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59593139, jitterRate=-0.11199302971363068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:02,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8e93d330f68b1c19592f63757c725102: Running coprocessor pre-open hook at 1675839782801Writing region info on filesystem at 1675839782801Initializing all the Stores at 1675839782803 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782803Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782804 (+1 ms)Cleaning up temporary data from old regions at 1675839782814 (+10 ms)Cleaning up detritus from prior splits at 1675839782815 (+1 ms)Running coprocessor post-open hooks at 1675839782821 (+6 ms)Region opened successfully at 1675839782821 2023-02-08 07:03:02,822 DEBUG [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f1 2023-02-08 07:03:02,822 DEBUG [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f1 2023-02-08 07:03:02,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102., pid=28, masterSystemTime=1675839782751 2023-02-08 07:03:02,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-08 07:03:02,822 INFO [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2604496a73cb471eea80d0b0607a018b columnFamilyName f1 2023-02-08 07:03:02,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure 87ed579046f8447473797d6e7dbb9f5a, server=jenkins-hbase4.apache.org,35861,1675839780480 in 228 msec 2023-02-08 07:03:02,823 INFO [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] regionserver.HStore(310): Store=2604496a73cb471eea80d0b0607a018b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,823 INFO [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:02,825 DEBUG [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f2 2023-02-08 07:03:02,825 DEBUG [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f2 2023-02-08 07:03:02,825 INFO [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2604496a73cb471eea80d0b0607a018b columnFamilyName f2 2023-02-08 07:03:02,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=87ed579046f8447473797d6e7dbb9f5a, ASSIGN in 397 msec 2023-02-08 07:03:02,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:02,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:02,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:02,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2086f18794bfb36e11dcdc9164e33d77, NAME => 'testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-08 07:03:02,826 INFO [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] regionserver.HStore(310): Store=2604496a73cb471eea80d0b0607a018b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:02,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:02,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:02,827 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=8e93d330f68b1c19592f63757c725102, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:02,827 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782827"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839782827"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839782827"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839782827"}]},"ts":"1675839782827"} 2023-02-08 07:03:02,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:02,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:02,829 INFO [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:02,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:02,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-08 07:03:02,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 8e93d330f68b1c19592f63757c725102, server=jenkins-hbase4.apache.org,32893,1675839780408 in 229 msec 2023-02-08 07:03:02,831 DEBUG [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77/f1 2023-02-08 07:03:02,831 DEBUG [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77/f1 2023-02-08 07:03:02,832 INFO [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2086f18794bfb36e11dcdc9164e33d77 columnFamilyName f1 2023-02-08 07:03:02,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8e93d330f68b1c19592f63757c725102, ASSIGN in 406 msec 2023-02-08 07:03:02,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:02,832 INFO [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] regionserver.HStore(310): Store=2086f18794bfb36e11dcdc9164e33d77/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,833 INFO [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:02,834 DEBUG [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77/f2 2023-02-08 07:03:02,834 DEBUG [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77/f2 2023-02-08 07:03:02,834 INFO [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2086f18794bfb36e11dcdc9164e33d77 columnFamilyName f2 2023-02-08 07:03:02,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:02,835 INFO [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] regionserver.HStore(310): Store=2086f18794bfb36e11dcdc9164e33d77/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2604496a73cb471eea80d0b0607a018b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73290450, jitterRate=0.09211280941963196}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:02,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2604496a73cb471eea80d0b0607a018b: Running coprocessor pre-open hook at 1675839782817Writing region info on filesystem at 1675839782817Initializing all the Stores at 1675839782819 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782819Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782820 (+1 ms)Cleaning up temporary data from old regions at 1675839782829 (+9 ms)Cleaning up detritus from prior splits at 1675839782829Running coprocessor post-open hooks at 1675839782835 (+6 ms)Region opened successfully at 1675839782835 2023-02-08 07:03:02,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:02,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b., pid=21, masterSystemTime=1675839782739 2023-02-08 07:03:02,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:02,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:02,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:02,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:02,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:02,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5a37be146e33fe5a01ef9b4ee5891029, NAME => 'testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-08 07:03:02,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:02,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:02,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:02,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:02,840 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2604496a73cb471eea80d0b0607a018b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:02,841 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675839781850.2604496a73cb471eea80d0b0607a018b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782840"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839782840"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839782840"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839782840"}]},"ts":"1675839782840"} 2023-02-08 07:03:02,841 INFO [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:02,843 DEBUG [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f1 2023-02-08 07:03:02,843 DEBUG [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f1 2023-02-08 07:03:02,843 INFO [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a37be146e33fe5a01ef9b4ee5891029 columnFamilyName f1 2023-02-08 07:03:02,844 INFO [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] regionserver.HStore(310): Store=5a37be146e33fe5a01ef9b4ee5891029/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,844 INFO [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:02,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-08 07:03:02,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure 2604496a73cb471eea80d0b0607a018b, server=jenkins-hbase4.apache.org,35861,1675839780480 in 257 msec 2023-02-08 07:03:02,846 DEBUG [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f2 2023-02-08 07:03:02,846 DEBUG [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f2 2023-02-08 07:03:02,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2604496a73cb471eea80d0b0607a018b, ASSIGN in 419 msec 2023-02-08 07:03:02,846 INFO [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a37be146e33fe5a01ef9b4ee5891029 columnFamilyName f2 2023-02-08 07:03:02,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:02,846 INFO [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] regionserver.HStore(310): Store=5a37be146e33fe5a01ef9b4ee5891029/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2086f18794bfb36e11dcdc9164e33d77; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61440706, jitterRate=-0.08446213603019714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:02,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2086f18794bfb36e11dcdc9164e33d77: Running coprocessor pre-open hook at 1675839782827Writing region info on filesystem at 1675839782827Initializing all the Stores at 1675839782828 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782828Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782829 (+1 ms)Cleaning up temporary data from old regions at 1675839782837 (+8 ms)Cleaning up detritus from prior splits at 1675839782838 (+1 ms)Running coprocessor post-open hooks at 1675839782847 (+9 ms)Region opened successfully at 1675839782847 2023-02-08 07:03:02,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:02,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77., pid=30, masterSystemTime=1675839782751 2023-02-08 07:03:02,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:02,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:02,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:02,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:02,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fb95ce31ec826d80712436cd5be5b26b, NAME => 'testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-08 07:03:02,849 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2086f18794bfb36e11dcdc9164e33d77, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:02,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:02,849 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675839782849"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839782849"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839782849"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839782849"}]},"ts":"1675839782849"} 2023-02-08 07:03:02,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:02,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:02,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:02,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:02,851 INFO [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:02,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:02,853 DEBUG [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f1 2023-02-08 07:03:02,853 DEBUG [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f1 2023-02-08 07:03:02,853 INFO [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb95ce31ec826d80712436cd5be5b26b columnFamilyName f1 2023-02-08 07:03:02,854 INFO [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] regionserver.HStore(310): Store=fb95ce31ec826d80712436cd5be5b26b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,854 INFO [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:02,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:02,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-08 07:03:02,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure 2086f18794bfb36e11dcdc9164e33d77, server=jenkins-hbase4.apache.org,32893,1675839780408 in 249 msec 2023-02-08 07:03:02,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5a37be146e33fe5a01ef9b4ee5891029; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63716687, jitterRate=-0.05054737627506256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:02,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5a37be146e33fe5a01ef9b4ee5891029: Running coprocessor pre-open hook at 1675839782840Writing region info on filesystem at 1675839782840Initializing all the Stores at 1675839782841 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782841Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782841Cleaning up temporary data from old regions at 1675839782848 (+7 ms)Cleaning up detritus from prior splits at 1675839782849 (+1 ms)Running coprocessor post-open hooks at 1675839782855 (+6 ms)Region opened successfully at 1675839782855 2023-02-08 07:03:02,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029., pid=23, masterSystemTime=1675839782739 2023-02-08 07:03:02,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2086f18794bfb36e11dcdc9164e33d77, ASSIGN in 430 msec 2023-02-08 07:03:02,857 DEBUG [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f2 2023-02-08 07:03:02,857 DEBUG [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f2 2023-02-08 07:03:02,857 INFO [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb95ce31ec826d80712436cd5be5b26b columnFamilyName f2 2023-02-08 07:03:02,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:02,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:02,858 INFO [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] regionserver.HStore(310): Store=fb95ce31ec826d80712436cd5be5b26b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:02,858 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=5a37be146e33fe5a01ef9b4ee5891029, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:02,858 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782858"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839782858"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839782858"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839782858"}]},"ts":"1675839782858"} 2023-02-08 07:03:02,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:02,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:02,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=17 2023-02-08 07:03:02,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=17, state=SUCCESS; OpenRegionProcedure 5a37be146e33fe5a01ef9b4ee5891029, server=jenkins-hbase4.apache.org,35861,1675839780480 in 272 msec 2023-02-08 07:03:02,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:02,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5a37be146e33fe5a01ef9b4ee5891029, ASSIGN in 436 msec 2023-02-08 07:03:02,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:02,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:02,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fb95ce31ec826d80712436cd5be5b26b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71205516, jitterRate=0.06104487180709839}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:02,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fb95ce31ec826d80712436cd5be5b26b: Running coprocessor pre-open hook at 1675839782850Writing region info on filesystem at 1675839782850Initializing all the Stores at 1675839782851 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782851Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839782851Cleaning up temporary data from old regions at 1675839782860 (+9 ms)Cleaning up detritus from prior splits at 1675839782860Running coprocessor post-open hooks at 1675839782865 (+5 ms)Region opened successfully at 1675839782865 2023-02-08 07:03:02,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b., pid=27, masterSystemTime=1675839782751 2023-02-08 07:03:02,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:02,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:02,868 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=fb95ce31ec826d80712436cd5be5b26b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:02,868 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675839782868"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839782868"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839782868"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839782868"}]},"ts":"1675839782868"} 2023-02-08 07:03:02,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=15 2023-02-08 07:03:02,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=15, state=SUCCESS; OpenRegionProcedure fb95ce31ec826d80712436cd5be5b26b, server=jenkins-hbase4.apache.org,32893,1675839780408 in 271 msec 2023-02-08 07:03:02,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-08 07:03:02,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fb95ce31ec826d80712436cd5be5b26b, ASSIGN in 446 msec 2023-02-08 07:03:02,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:03:02,873 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839782873"}]},"ts":"1675839782873"} 2023-02-08 07:03:02,875 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-08 07:03:02,877 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:03:02,878 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.0260 sec 2023-02-08 07:03:02,969 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-08 07:03:02,970 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:02,970 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:02,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:02,972 INFO [Listener at localhost/40875] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-08 07:03:02,972 DEBUG [Listener at localhost/40875] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-08 07:03:02,972 INFO [Listener at localhost/40875] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:03:02,979 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-08 07:03:02,979 INFO [Listener at localhost/40875] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:03:02,979 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-08 07:03:02,979 INFO [Listener at localhost/40875] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 07:03:03,042 DEBUG [hconnection-0x5f08c7d5-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:03,060 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46432, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:03,066 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32893] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:03,073 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35861] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:03,188 INFO [Listener at localhost/40875] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 07:03:03,188 INFO [Listener at localhost/40875] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 07:03:03,188 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:03,189 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:03,190 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 07:03:03,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675839783190 (current time:1675839783190). 2023-02-08 07:03:03,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 07:03:03,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] zookeeper.ReadOnlyZKClient(139): Connect 0x329bb430 to 127.0.0.1:55841 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:03,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61f5a3a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:03,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:03,202 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41790, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:03,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x329bb430 to 127.0.0.1:55841 2023-02-08 07:03:03,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:03,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 07:03:03,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 07:03:03,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 07:03:03,207 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 07:03:03,207 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675840383207 2023-02-08 07:03:03,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 07:03:03,208 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-08 07:03:03,209 DEBUG [Listener at localhost/40875] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 07:03:03,209 DEBUG [Listener at localhost/40875] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 07:03:03,210 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 07:03:03,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 07:03:03,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-08 07:03:03,211 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 07:03:03,212 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675840383212 2023-02-08 07:03:03,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,232 INFO [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-08 07:03:03,232 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:03,233 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-08 07:03:03,233 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-08 07:03:03,306 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,306 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,307 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:03,307 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:03,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:03,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:03,307 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:03,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:03,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,308 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,308 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,309 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,309 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:03:03,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-08 07:03:03,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,309 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-08 07:03:03,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-08 07:03:03,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,309 DEBUG [Listener at localhost/40875] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:03,309 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-08 07:03:03,309 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:03,309 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:03,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,310 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-08 07:03:03,310 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-08 07:03:03,310 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:03,310 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:03,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 07:03:03,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:03:03,311 DEBUG [Listener at localhost/40875] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 07:03:03,313 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-08 07:03:03,313 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-08 07:03:03,313 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-08 07:03:03,313 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-08 07:03:03,313 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35861,1675839780480' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-08 07:03:03,313 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32893,1675839780408' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-08 07:03:03,315 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,315 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:03,317 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,317 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,318 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,318 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:03,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:03,318 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,318 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:03,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:03,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:03,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35861,1675839780480' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-08 07:03:03,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6777a5d5[Count = 1] remaining members to acquire global barrier 2023-02-08 07:03:03,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:03,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:03,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:03,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:03,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:03,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32893,1675839780408' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-08 07:03:03,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6777a5d5[Count = 0] remaining members to acquire global barrier 2023-02-08 07:03:03,323 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-08 07:03:03,323 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,324 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,324 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,324 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-08 07:03:03,325 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-08 07:03:03,325 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,325 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:03,325 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. started... 2023-02-08 07:03:03,325 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:03,325 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,325 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:03:03,325 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. started... 2023-02-08 07:03:03,326 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4fc7d21cab2b5376dc37cc4929bd3e2c: 2023-02-08 07:03:03,326 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-08 07:03:03,326 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 07:03:03,326 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:03,325 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:03,327 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:03,327 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,327 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. started... 2023-02-08 07:03:03,327 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:03,327 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] regionserver.HRegion(2744): Flushing fb95ce31ec826d80712436cd5be5b26b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:03:03,327 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. started... 2023-02-08 07:03:03,327 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-08 07:03:03,329 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 07:03:03,326 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:03,329 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 6c88256eab2776d728497dd2d0c75425 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-08 07:03:03,328 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HRegion(2744): Flushing c2f1e88c1e2851f70723fd0a9ceb68e4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:03:03,328 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 07:03:03,327 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. started... 2023-02-08 07:03:03,329 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 07:03:03,329 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. started... 2023-02-08 07:03:03,330 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] regionserver.HRegion(2744): Flushing acd414963aca9bf4723dc883c453251f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:03:03,330 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 87ed579046f8447473797d6e7dbb9f5a 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-08 07:03:03,398 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. completed. 2023-02-08 07:03:03,398 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:03,399 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:03,399 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-08 07:03:03,399 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. started... 2023-02-08 07:03:03,414 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2086f18794bfb36e11dcdc9164e33d77: 2023-02-08 07:03:03,415 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/.tmp/f1/2961dcf3a9b742c1b471e6444bd2b7bb 2023-02-08 07:03:03,415 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,415 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:03,415 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 07:03:03,415 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 07:03:03,425 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/.tmp/f1/c9301d86fd934b1c8d85d006554f63b8 2023-02-08 07:03:03,432 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/.tmp/f1/1978abbd04d947a88b1adf3bd988375e 2023-02-08 07:03:03,433 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/.tmp/f1/f1173d0dc2994bdcbd06f4a0c6640c66 2023-02-08 07:03:03,468 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/.tmp/f1/e2834469877549cb8e0f2b0eed0aa37f 2023-02-08 07:03:03,476 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. completed. 2023-02-08 07:03:03,476 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:03,476 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:03,476 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-08 07:03:03,476 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. started... 2023-02-08 07:03:03,477 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/.tmp/f2/51005b340e3d4f9983dbb05f670bfe30 2023-02-08 07:03:03,477 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 8e93d330f68b1c19592f63757c725102 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:03:03,495 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/.tmp/f1/2961dcf3a9b742c1b471e6444bd2b7bb as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f1/2961dcf3a9b742c1b471e6444bd2b7bb 2023-02-08 07:03:03,496 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/.tmp/f2/ee165eb555fd42648d18dc347b6810d4 2023-02-08 07:03:03,502 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/.tmp/f2/7ee67342a680425880b3f408a7f942a7 2023-02-08 07:03:03,507 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f1/2961dcf3a9b742c1b471e6444bd2b7bb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:03,508 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/.tmp/f2/51005b340e3d4f9983dbb05f670bfe30 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f2/51005b340e3d4f9983dbb05f670bfe30 2023-02-08 07:03:03,512 DEBUG [Listener at localhost/40875] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:03,512 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:03,512 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:03,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 07:03:03,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:03:03,514 DEBUG [Listener at localhost/40875] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-08 07:03:03,517 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/.tmp/f1/f1173d0dc2994bdcbd06f4a0c6640c66 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f1/f1173d0dc2994bdcbd06f4a0c6640c66 2023-02-08 07:03:03,517 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/.tmp/f1/af274e8cbbd54be9a525474d0bd0acfe 2023-02-08 07:03:03,520 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f2/51005b340e3d4f9983dbb05f670bfe30, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:03,521 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c2f1e88c1e2851f70723fd0a9ceb68e4 in 193ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:03,521 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-08 07:03:03,522 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for c2f1e88c1e2851f70723fd0a9ceb68e4: 2023-02-08 07:03:03,522 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,522 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/.tmp/f1/1978abbd04d947a88b1adf3bd988375e as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f1/1978abbd04d947a88b1adf3bd988375e 2023-02-08 07:03:03,522 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:03,522 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f1/2961dcf3a9b742c1b471e6444bd2b7bb] hfiles 2023-02-08 07:03:03,522 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f1/2961dcf3a9b742c1b471e6444bd2b7bb for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,522 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f2/51005b340e3d4f9983dbb05f670bfe30] hfiles 2023-02-08 07:03:03,522 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f2/51005b340e3d4f9983dbb05f670bfe30 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,525 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f1/f1173d0dc2994bdcbd06f4a0c6640c66, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 07:03:03,526 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/.tmp/f2/ee165eb555fd42648d18dc347b6810d4 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f2/ee165eb555fd42648d18dc347b6810d4 2023-02-08 07:03:03,529 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f1/1978abbd04d947a88b1adf3bd988375e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 07:03:03,530 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/.tmp/f2/7ee67342a680425880b3f408a7f942a7 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f2/7ee67342a680425880b3f408a7f942a7 2023-02-08 07:03:03,545 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f2/7ee67342a680425880b3f408a7f942a7, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 07:03:03,546 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 6c88256eab2776d728497dd2d0c75425 in 217ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:03,547 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 6c88256eab2776d728497dd2d0c75425: 2023-02-08 07:03:03,548 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,548 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:03,548 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f1/1978abbd04d947a88b1adf3bd988375e] hfiles 2023-02-08 07:03:03,548 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f1/1978abbd04d947a88b1adf3bd988375e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,548 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f2/7ee67342a680425880b3f408a7f942a7] hfiles 2023-02-08 07:03:03,548 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f2/7ee67342a680425880b3f408a7f942a7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,550 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f2/ee165eb555fd42648d18dc347b6810d4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 07:03:03,550 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 87ed579046f8447473797d6e7dbb9f5a in 220ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:03,551 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 87ed579046f8447473797d6e7dbb9f5a: 2023-02-08 07:03:03,551 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,551 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:03,551 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f1/f1173d0dc2994bdcbd06f4a0c6640c66] hfiles 2023-02-08 07:03:03,551 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f1/f1173d0dc2994bdcbd06f4a0c6640c66 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,551 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f2/ee165eb555fd42648d18dc347b6810d4] hfiles 2023-02-08 07:03:03,551 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f2/ee165eb555fd42648d18dc347b6810d4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,552 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/.tmp/f2/a89fc29eaa2b4c5585071f76a72fa445 2023-02-08 07:03:03,574 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. completed. 2023-02-08 07:03:03,574 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:03,574 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:03,575 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-08 07:03:03,575 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. started... 2023-02-08 07:03:03,575 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2604496a73cb471eea80d0b0607a018b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:03:03,578 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/.tmp/f1/e2834469877549cb8e0f2b0eed0aa37f as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f1/e2834469877549cb8e0f2b0eed0aa37f 2023-02-08 07:03:03,585 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/.tmp/f2/d293b32d05654df19765c3070e09183c 2023-02-08 07:03:03,585 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. completed. 2023-02-08 07:03:03,585 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:03,585 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f1/e2834469877549cb8e0f2b0eed0aa37f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:03,585 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-08 07:03:03,585 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:03,586 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. started... 2023-02-08 07:03:03,586 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 5a37be146e33fe5a01ef9b4ee5891029 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:03:03,588 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/.tmp/f2/a89fc29eaa2b4c5585071f76a72fa445 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f2/a89fc29eaa2b4c5585071f76a72fa445 2023-02-08 07:03:03,592 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. completed. 2023-02-08 07:03:03,592 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:03,592 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-08 07:03:03,601 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f2/a89fc29eaa2b4c5585071f76a72fa445, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:03,601 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/.tmp/f1/af274e8cbbd54be9a525474d0bd0acfe as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f1/af274e8cbbd54be9a525474d0bd0acfe 2023-02-08 07:03:03,602 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fb95ce31ec826d80712436cd5be5b26b in 275ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:03,602 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for fb95ce31ec826d80712436cd5be5b26b: 2023-02-08 07:03:03,602 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,602 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:03,602 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f1/e2834469877549cb8e0f2b0eed0aa37f] hfiles 2023-02-08 07:03:03,602 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f1/e2834469877549cb8e0f2b0eed0aa37f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,602 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f2/a89fc29eaa2b4c5585071f76a72fa445] hfiles 2023-02-08 07:03:03,602 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f2/a89fc29eaa2b4c5585071f76a72fa445 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,607 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f1/af274e8cbbd54be9a525474d0bd0acfe, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:03,608 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/.tmp/f2/d293b32d05654df19765c3070e09183c as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f2/d293b32d05654df19765c3070e09183c 2023-02-08 07:03:03,624 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f2/d293b32d05654df19765c3070e09183c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:03,625 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8e93d330f68b1c19592f63757c725102 in 148ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:03,625 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8e93d330f68b1c19592f63757c725102: 2023-02-08 07:03:03,626 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,626 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:03,626 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f1/af274e8cbbd54be9a525474d0bd0acfe] hfiles 2023-02-08 07:03:03,626 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f1/af274e8cbbd54be9a525474d0bd0acfe for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,626 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f2/d293b32d05654df19765c3070e09183c] hfiles 2023-02-08 07:03:03,626 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/.tmp/f1/34b8de7f56874313b4bb94b71e20609b 2023-02-08 07:03:03,626 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f2/d293b32d05654df19765c3070e09183c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,643 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. completed. 2023-02-08 07:03:03,643 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:03,643 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-08 07:03:03,652 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/.tmp/f1/17be0ba7e6564a7b95fe119da6bebeff 2023-02-08 07:03:03,660 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. completed. 2023-02-08 07:03:03,660 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:03,660 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-08 07:03:03,660 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-08 07:03:03,660 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,660 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-08 07:03:03,660 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,32893,1675839780408' in zk 2023-02-08 07:03:03,662 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-08 07:03:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-08 07:03:03,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:03,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:03,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:03,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,32893,1675839780408': 2023-02-08 07:03:03,668 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/.tmp/f2/9c76f229559c48d590459187078922bf 2023-02-08 07:03:03,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32893,1675839780408' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-08 07:03:03,674 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/.tmp/f1/34b8de7f56874313b4bb94b71e20609b as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f1/34b8de7f56874313b4bb94b71e20609b 2023-02-08 07:03:03,680 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f1/34b8de7f56874313b4bb94b71e20609b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:03,680 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/.tmp/f2/568a21ff12d449cb820c5facd1084f9c 2023-02-08 07:03:03,681 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/.tmp/f2/9c76f229559c48d590459187078922bf as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f2/9c76f229559c48d590459187078922bf 2023-02-08 07:03:03,687 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/.tmp/f1/17be0ba7e6564a7b95fe119da6bebeff as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f1/17be0ba7e6564a7b95fe119da6bebeff 2023-02-08 07:03:03,689 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f2/9c76f229559c48d590459187078922bf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:03,690 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2604496a73cb471eea80d0b0607a018b in 114ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:03,690 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2604496a73cb471eea80d0b0607a018b: 2023-02-08 07:03:03,690 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,690 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:03,690 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f1/34b8de7f56874313b4bb94b71e20609b] hfiles 2023-02-08 07:03:03,690 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f1/34b8de7f56874313b4bb94b71e20609b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,690 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f2/9c76f229559c48d590459187078922bf] hfiles 2023-02-08 07:03:03,690 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f2/9c76f229559c48d590459187078922bf for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,693 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f1/17be0ba7e6564a7b95fe119da6bebeff, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:03,694 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/.tmp/f2/568a21ff12d449cb820c5facd1084f9c as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f2/568a21ff12d449cb820c5facd1084f9c 2023-02-08 07:03:03,699 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f2/568a21ff12d449cb820c5facd1084f9c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:03,700 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5a37be146e33fe5a01ef9b4ee5891029 in 114ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:03,700 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5a37be146e33fe5a01ef9b4ee5891029: 2023-02-08 07:03:03,700 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,700 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:03,700 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f1/17be0ba7e6564a7b95fe119da6bebeff] hfiles 2023-02-08 07:03:03,700 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f1/17be0ba7e6564a7b95fe119da6bebeff for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,700 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f2/568a21ff12d449cb820c5facd1084f9c] hfiles 2023-02-08 07:03:03,700 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f2/568a21ff12d449cb820c5facd1084f9c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,712 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. completed. 2023-02-08 07:03:03,712 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:03,712 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-08 07:03:03,716 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. completed. 2023-02-08 07:03:03,716 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:03,716 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-08 07:03:03,814 DEBUG [Listener at localhost/40875] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:03,814 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:03,814 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:03,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 07:03:03,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:03:03,816 DEBUG [Listener at localhost/40875] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-08 07:03:03,906 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/.tmp/f2/59dff5ad79e54816a35d286dca395125 2023-02-08 07:03:03,913 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/.tmp/f1/c9301d86fd934b1c8d85d006554f63b8 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f1/c9301d86fd934b1c8d85d006554f63b8 2023-02-08 07:03:03,918 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f1/c9301d86fd934b1c8d85d006554f63b8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:03,919 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/.tmp/f2/59dff5ad79e54816a35d286dca395125 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f2/59dff5ad79e54816a35d286dca395125 2023-02-08 07:03:03,924 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f2/59dff5ad79e54816a35d286dca395125, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:03,925 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for acd414963aca9bf4723dc883c453251f in 595ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:03,925 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for acd414963aca9bf4723dc883c453251f: 2023-02-08 07:03:03,925 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,925 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:03,925 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f1/c9301d86fd934b1c8d85d006554f63b8] hfiles 2023-02-08 07:03:03,925 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f1/c9301d86fd934b1c8d85d006554f63b8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,925 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f2/59dff5ad79e54816a35d286dca395125] hfiles 2023-02-08 07:03:03,925 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f2/59dff5ad79e54816a35d286dca395125 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,931 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. completed. 2023-02-08 07:03:03,931 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:03,931 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-08 07:03:03,931 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-08 07:03:03,931 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,931 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-08 07:03:03,932 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,35861,1675839780480' in zk 2023-02-08 07:03:03,933 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,933 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-08 07:03:03,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:03,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:03,933 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:03,933 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-08 07:03:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,35861,1675839780480': 2023-02-08 07:03:03,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35861,1675839780480' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-08 07:03:03,937 INFO [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-08 07:03:03,937 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:03:03,937 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:03:03,938 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,938 INFO [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 07:03:03,940 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,940 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,940 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:03,940 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,941 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:03,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:03,941 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,943 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,943 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:03,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:03,943 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:03,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:03,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,952 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:03,952 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:03,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:03,952 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:03,952 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:03,952 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:03,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,952 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:03,952 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:03,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:03,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:03,953 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:03,954 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,954 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:03,954 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,954 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:03,954 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,954 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion because node does not exist (not an error) 2023-02-08 07:03:03,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:03,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:04,019 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-08 07:03:04,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:04,019 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:04,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675839783208Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675839783953 (+745 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1675839783953Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1675839783961 (+8 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675839783974 (+13 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1675839784019 (+45 ms) 2023-02-08 07:03:04,021 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 07:03:04,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 812 msec 2023-02-08 07:03:04,316 DEBUG [Listener at localhost/40875] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:04,316 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:04,316 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:04,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 07:03:04,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 07:03:04,318 INFO [Listener at localhost/40875] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 07:03:04,318 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:04,319 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:04,323 INFO [Listener at localhost/40875] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 07:03:04,332 INFO [Listener at localhost/40875] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 07:03:04,371 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32893] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:04,381 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35861] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:04,696 INFO [Listener at localhost/40875] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 07:03:04,700 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:04,701 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:04,703 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 07:03:04,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-08 07:03:04,707 INFO [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-08 07:03:04,707 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:04,707 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-08 07:03:04,708 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-08 07:03:04,708 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:04,708 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:04,710 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:04,710 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:04,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:04,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:04,710 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:04,710 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:04,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:04,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:04,711 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:03:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:03:04,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:04,712 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-08 07:03:04,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:04,712 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-08 07:03:04,712 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:04,712 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:03:04,712 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-08 07:03:04,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-08 07:03:04,716 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-08 07:03:04,716 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:04,721 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-08 07:03:04,721 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-08 07:03:04,721 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:04,721 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:04,722 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-08 07:03:04,722 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:04,722 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-08 07:03:04,722 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:04,722 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. started... 2023-02-08 07:03:04,722 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. started... 2023-02-08 07:03:04,722 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 07:03:04,722 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. started... 2023-02-08 07:03:04,722 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c2f1e88c1e2851f70723fd0a9ceb68e4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:03:04,722 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing acd414963aca9bf4723dc883c453251f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:03:04,722 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 87ed579046f8447473797d6e7dbb9f5a 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-08 07:03:04,723 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:04,723 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. started... 2023-02-08 07:03:04,723 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4fc7d21cab2b5376dc37cc4929bd3e2c: 2023-02-08 07:03:04,723 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:04,723 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:04,723 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. started... 2023-02-08 07:03:04,724 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing fb95ce31ec826d80712436cd5be5b26b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:03:04,724 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-08 07:03:04,724 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 07:03:04,725 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-08 07:03:04,729 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:04,729 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:04,729 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. started... 2023-02-08 07:03:04,729 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. started... 2023-02-08 07:03:04,729 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2086f18794bfb36e11dcdc9164e33d77: 2023-02-08 07:03:04,730 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:04,730 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6c88256eab2776d728497dd2d0c75425 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-08 07:03:04,730 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-08 07:03:04,730 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:04,730 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. started... 2023-02-08 07:03:04,730 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e93d330f68b1c19592f63757c725102 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:03:04,772 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/.tmp/f1/882b8f7b34fa40f981f8c6ea47b03bd7 2023-02-08 07:03:04,773 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/.tmp/f1/b6c4d3889509415f9e9dd94dfad10c1b 2023-02-08 07:03:04,782 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/.tmp/f1/36e340d9e927495a848f1ea14501d22f 2023-02-08 07:03:04,792 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/.tmp/f1/7c19de91e43a4b4f8f9a12b9093f95e4 2023-02-08 07:03:04,809 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/.tmp/f1/236a39ce701f4612a631d9ae0bf7785a 2023-02-08 07:03:04,810 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/.tmp/f1/5c291829714e4951890cac2c2ed8ac18 2023-02-08 07:03:04,815 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/.tmp/f2/0663d5761aff482e936581c960bbea36 2023-02-08 07:03:04,823 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/.tmp/f1/b6c4d3889509415f9e9dd94dfad10c1b as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f1/b6c4d3889509415f9e9dd94dfad10c1b 2023-02-08 07:03:04,826 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/.tmp/f2/67fa77e663a14542afb0391f14e3cfbc 2023-02-08 07:03:04,830 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f1/b6c4d3889509415f9e9dd94dfad10c1b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 07:03:04,833 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/.tmp/f1/882b8f7b34fa40f981f8c6ea47b03bd7 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f1/882b8f7b34fa40f981f8c6ea47b03bd7 2023-02-08 07:03:04,838 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/.tmp/f2/0663d5761aff482e936581c960bbea36 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f2/0663d5761aff482e936581c960bbea36 2023-02-08 07:03:04,841 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f1/882b8f7b34fa40f981f8c6ea47b03bd7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:04,842 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/.tmp/f2/67fa77e663a14542afb0391f14e3cfbc as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f2/67fa77e663a14542afb0391f14e3cfbc 2023-02-08 07:03:04,848 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/.tmp/f2/af69e0efd1a840e7ba3bb682a644b978 2023-02-08 07:03:04,850 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f2/0663d5761aff482e936581c960bbea36, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 07:03:04,851 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 6c88256eab2776d728497dd2d0c75425 in 122ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:04,851 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6c88256eab2776d728497dd2d0c75425: 2023-02-08 07:03:04,851 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:04,852 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-08 07:03:04,852 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f2/67fa77e663a14542afb0391f14e3cfbc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:04,853 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fb95ce31ec826d80712436cd5be5b26b in 129ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:04,853 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fb95ce31ec826d80712436cd5be5b26b: 2023-02-08 07:03:04,853 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:04,853 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-08 07:03:04,854 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/.tmp/f1/36e340d9e927495a848f1ea14501d22f as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f1/36e340d9e927495a848f1ea14501d22f 2023-02-08 07:03:04,859 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f1/36e340d9e927495a848f1ea14501d22f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:04,863 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/.tmp/f2/af69e0efd1a840e7ba3bb682a644b978 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f2/af69e0efd1a840e7ba3bb682a644b978 2023-02-08 07:03:04,864 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/.tmp/f2/8983611547ff42acbe943a62271b505a 2023-02-08 07:03:04,868 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f2/af69e0efd1a840e7ba3bb682a644b978, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:04,869 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for acd414963aca9bf4723dc883c453251f in 147ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:04,869 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for acd414963aca9bf4723dc883c453251f: 2023-02-08 07:03:04,869 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:04,870 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/.tmp/f1/7c19de91e43a4b4f8f9a12b9093f95e4 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f1/7c19de91e43a4b4f8f9a12b9093f95e4 2023-02-08 07:03:04,872 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:04,872 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-08 07:03:04,872 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. started... 2023-02-08 07:03:04,872 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2604496a73cb471eea80d0b0607a018b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:03:04,874 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f1/7c19de91e43a4b4f8f9a12b9093f95e4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:04,875 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/.tmp/f2/8983611547ff42acbe943a62271b505a as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f2/8983611547ff42acbe943a62271b505a 2023-02-08 07:03:04,889 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f2/8983611547ff42acbe943a62271b505a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:04,890 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c2f1e88c1e2851f70723fd0a9ceb68e4 in 168ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:04,890 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c2f1e88c1e2851f70723fd0a9ceb68e4: 2023-02-08 07:03:04,890 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:04,891 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:04,891 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. started... 2023-02-08 07:03:04,891 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-08 07:03:04,891 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5a37be146e33fe5a01ef9b4ee5891029 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:03:04,891 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/.tmp/f2/4122ae3936ba48aebaee0d0a9751dcff 2023-02-08 07:03:04,896 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/.tmp/f2/0d9d760df7f44b84bb2fabd26b91bb91 2023-02-08 07:03:04,899 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/.tmp/f1/5c291829714e4951890cac2c2ed8ac18 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f1/5c291829714e4951890cac2c2ed8ac18 2023-02-08 07:03:04,906 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/.tmp/f1/236a39ce701f4612a631d9ae0bf7785a as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f1/236a39ce701f4612a631d9ae0bf7785a 2023-02-08 07:03:04,911 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f1/236a39ce701f4612a631d9ae0bf7785a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:04,912 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/.tmp/f2/0d9d760df7f44b84bb2fabd26b91bb91 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f2/0d9d760df7f44b84bb2fabd26b91bb91 2023-02-08 07:03:04,924 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/.tmp/f1/f5dbc333b5c6434aa5be3d0ccb2681ba 2023-02-08 07:03:04,929 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f2/0d9d760df7f44b84bb2fabd26b91bb91, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:04,929 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f1/5c291829714e4951890cac2c2ed8ac18, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 07:03:04,930 INFO [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8e93d330f68b1c19592f63757c725102 in 200ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:04,930 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e93d330f68b1c19592f63757c725102: 2023-02-08 07:03:04,930 DEBUG [rs(jenkins-hbase4.apache.org,32893,1675839780408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:04,930 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-08 07:03:04,930 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-08 07:03:04,930 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:04,931 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-08 07:03:04,931 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32893,1675839780408' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-08 07:03:04,931 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/.tmp/f2/4122ae3936ba48aebaee0d0a9751dcff as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f2/4122ae3936ba48aebaee0d0a9751dcff 2023-02-08 07:03:04,931 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/.tmp/f1/93603f0c101445929e25c941c8cc7324 2023-02-08 07:03:04,932 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:04,933 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:04,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:04,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:04,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:04,933 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:04,933 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:04,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:04,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:04,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:04,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:04,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32893,1675839780408' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-08 07:03:04,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63482de3[Count = 1] remaining members to acquire global barrier 2023-02-08 07:03:04,938 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f2/4122ae3936ba48aebaee0d0a9751dcff, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 07:03:04,939 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 87ed579046f8447473797d6e7dbb9f5a in 217ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:04,939 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 87ed579046f8447473797d6e7dbb9f5a: 2023-02-08 07:03:04,940 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:04,940 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-08 07:03:04,960 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/.tmp/f2/b21379ba23584fafaf95f0869eac6afb 2023-02-08 07:03:04,966 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/.tmp/f1/f5dbc333b5c6434aa5be3d0ccb2681ba as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f1/f5dbc333b5c6434aa5be3d0ccb2681ba 2023-02-08 07:03:04,978 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f1/f5dbc333b5c6434aa5be3d0ccb2681ba, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:04,979 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/.tmp/f2/b21379ba23584fafaf95f0869eac6afb as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f2/b21379ba23584fafaf95f0869eac6afb 2023-02-08 07:03:04,985 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f2/b21379ba23584fafaf95f0869eac6afb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:04,986 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5a37be146e33fe5a01ef9b4ee5891029 in 95ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:04,986 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5a37be146e33fe5a01ef9b4ee5891029: 2023-02-08 07:03:04,986 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:04,986 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-08 07:03:05,360 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/.tmp/f2/edc493c73fc94423a66ba43e26fff94a 2023-02-08 07:03:05,366 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/.tmp/f1/93603f0c101445929e25c941c8cc7324 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f1/93603f0c101445929e25c941c8cc7324 2023-02-08 07:03:05,371 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f1/93603f0c101445929e25c941c8cc7324, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:05,372 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/.tmp/f2/edc493c73fc94423a66ba43e26fff94a as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f2/edc493c73fc94423a66ba43e26fff94a 2023-02-08 07:03:05,377 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f2/edc493c73fc94423a66ba43e26fff94a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:05,378 INFO [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2604496a73cb471eea80d0b0607a018b in 506ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:05,378 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2604496a73cb471eea80d0b0607a018b: 2023-02-08 07:03:05,378 DEBUG [rs(jenkins-hbase4.apache.org,35861,1675839780480)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:05,378 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-08 07:03:05,378 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-08 07:03:05,378 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,378 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-08 07:03:05,378 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35861,1675839780480' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-08 07:03:05,380 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,380 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:05,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:05,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:05,381 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:05,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:05,381 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:05,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:05,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:05,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:05,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35861,1675839780480' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-08 07:03:05,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63482de3[Count = 0] remaining members to acquire global barrier 2023-02-08 07:03:05,383 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-08 07:03:05,383 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:05,384 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:05,384 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:05,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:05,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:05,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:05,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:05,384 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-08 07:03:05,384 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-08 07:03:05,384 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-08 07:03:05,384 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,384 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-08 07:03:05,385 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35861,1675839780480' in zk 2023-02-08 07:03:05,384 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,32893,1675839780408' in zk 2023-02-08 07:03:05,385 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,385 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:03:05,386 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,386 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-08 07:03:05,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:05,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:05,386 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:05,386 DEBUG [member: 'jenkins-hbase4.apache.org,35861,1675839780480' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-08 07:03:05,387 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-08 07:03:05,387 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,387 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:05,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:05,387 DEBUG [member: 'jenkins-hbase4.apache.org,32893,1675839780408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-08 07:03:05,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:05,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:05,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:05,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:05,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35861,1675839780480': 2023-02-08 07:03:05,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35861,1675839780480' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-08 07:03:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:05,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:05,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,32893,1675839780408': 2023-02-08 07:03:05,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32893,1675839780408' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-08 07:03:05,394 INFO [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-08 07:03:05,394 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:03:05,394 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:03:05,394 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-08 07:03:05,394 INFO [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 07:03:05,397 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:05,397 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:05,397 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:05,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:05,397 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:05,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:05,397 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:05,397 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:05,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:05,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:05,398 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:05,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:05,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:05,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,399 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,400 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:05,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:05,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,402 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,402 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:05,402 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,402 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:05,402 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,402 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:05,402 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:05,402 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,403 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:05,403 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:05,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:05,403 DEBUG [(jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:05,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:05,402 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:05,403 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-08 07:03:05,404 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 07:03:05,403 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:05,403 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:05,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:05,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:05,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:05,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:05,404 DEBUG [Listener at localhost/40875] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-08 07:03:05,404 DEBUG [Listener at localhost/40875] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 07:03:05,504 DEBUG [Listener at localhost/40875] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 07:03:05,505 INFO [Listener at localhost/40875] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:05,505 INFO [Listener at localhost/40875] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:05,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45251] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 07:03:05,506 INFO [Listener at localhost/40875] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 07:03:05,507 DEBUG [Listener at localhost/40875] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x539bc584 to 127.0.0.1:55841 2023-02-08 07:03:05,507 DEBUG [Listener at localhost/40875] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:05,507 DEBUG [Listener at localhost/40875] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 07:03:05,507 DEBUG [Listener at localhost/40875] util.JVMClusterUtil(257): Found active master hash=1604370068, stopped=false 2023-02-08 07:03:05,507 INFO [Listener at localhost/40875] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45251,1675839780181 2023-02-08 07:03:05,509 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:05,509 INFO [Listener at localhost/40875] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 07:03:05,509 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:05,509 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:05,510 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:05,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:05,511 DEBUG [Listener at localhost/40875] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5024daaf to 127.0.0.1:55841 2023-02-08 07:03:05,511 DEBUG [Listener at localhost/40875] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:05,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:05,511 INFO [Listener at localhost/40875] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32893,1675839780408' ***** 2023-02-08 07:03:05,511 INFO [Listener at localhost/40875] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:03:05,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:05,511 INFO [Listener at localhost/40875] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35861,1675839780480' ***** 2023-02-08 07:03:05,512 INFO [Listener at localhost/40875] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:03:05,512 INFO [RS:0;jenkins-hbase4:32893] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:03:05,512 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:03:05,512 INFO [RS:0;jenkins-hbase4:32893] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:03:05,512 INFO [RS:1;jenkins-hbase4:35861] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:03:05,513 INFO [RS:0;jenkins-hbase4:32893] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:03:05,513 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:03:05,513 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(3304): Received CLOSE for 4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:05,513 INFO [RS:1;jenkins-hbase4:35861] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:03:05,514 INFO [RS:1;jenkins-hbase4:35861] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:03:05,514 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(3304): Received CLOSE for fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:05,514 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(3304): Received CLOSE for c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:05,514 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(3304): Received CLOSE for 25782ea441c1f8abbf9353ed96f175a2 2023-02-08 07:03:05,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4fc7d21cab2b5376dc37cc4929bd3e2c, disabling compactions & flushes 2023-02-08 07:03:05,514 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(3304): Received CLOSE for 87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:05,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:05,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c2f1e88c1e2851f70723fd0a9ceb68e4, disabling compactions & flushes 2023-02-08 07:03:05,514 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(3304): Received CLOSE for 6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:05,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:05,514 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(3304): Received CLOSE for 2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:05,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:05,514 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(3304): Received CLOSE for acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:05,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. after waiting 0 ms 2023-02-08 07:03:05,514 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(3304): Received CLOSE for 2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:05,514 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(3304): Received CLOSE for 8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:05,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:05,515 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:05,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. after waiting 0 ms 2023-02-08 07:03:05,515 DEBUG [RS:0;jenkins-hbase4:32893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1941983d to 127.0.0.1:55841 2023-02-08 07:03:05,515 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(3304): Received CLOSE for 5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:05,515 DEBUG [RS:0;jenkins-hbase4:32893] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:05,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:05,515 INFO [RS:0;jenkins-hbase4:32893] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:03:05,515 INFO [RS:0;jenkins-hbase4:32893] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:03:05,515 INFO [RS:0;jenkins-hbase4:32893] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:03:05,515 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,515 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 07:03:05,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:05,515 DEBUG [RS:1;jenkins-hbase4:35861] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27a46b09 to 127.0.0.1:55841 2023-02-08 07:03:05,515 DEBUG [RS:1;jenkins-hbase4:35861] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:05,515 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-08 07:03:05,515 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-08 07:03:05,515 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:03:05,515 DEBUG [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1479): Online Regions={4fc7d21cab2b5376dc37cc4929bd3e2c=testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c., fb95ce31ec826d80712436cd5be5b26b=testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b., 25782ea441c1f8abbf9353ed96f175a2=hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2., 6c88256eab2776d728497dd2d0c75425=testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425., 2086f18794bfb36e11dcdc9164e33d77=testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77., 1588230740=hbase:meta,,1.1588230740, 8e93d330f68b1c19592f63757c725102=testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102.} 2023-02-08 07:03:05,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:03:05,515 DEBUG [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(1479): Online Regions={c2f1e88c1e2851f70723fd0a9ceb68e4=testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4., 87ed579046f8447473797d6e7dbb9f5a=testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a., acd414963aca9bf4723dc883c453251f=testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f., 2604496a73cb471eea80d0b0607a018b=testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b., 5a37be146e33fe5a01ef9b4ee5891029=testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029.} 2023-02-08 07:03:05,516 DEBUG [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1505): Waiting on 1588230740, 2086f18794bfb36e11dcdc9164e33d77, 25782ea441c1f8abbf9353ed96f175a2, 4fc7d21cab2b5376dc37cc4929bd3e2c, 6c88256eab2776d728497dd2d0c75425, 8e93d330f68b1c19592f63757c725102, fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:05,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:03:05,516 DEBUG [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(1505): Waiting on 2604496a73cb471eea80d0b0607a018b, 5a37be146e33fe5a01ef9b4ee5891029, 87ed579046f8447473797d6e7dbb9f5a, acd414963aca9bf4723dc883c453251f, c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:05,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:03:05,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:03:05,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-08 07:03:05,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 07:03:05,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:05,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:05,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4fc7d21cab2b5376dc37cc4929bd3e2c: Waiting for close lock at 1675839785514Running coprocessor pre-close hooks at 1675839785514Disabling compacts and flushes for region at 1675839785514Disabling writes for close at 1675839785514Writing region close event to WAL at 1675839785515 (+1 ms)Running coprocessor post-close hooks at 1675839785527 (+12 ms)Closed at 1675839785527 2023-02-08 07:03:05,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:05,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fb95ce31ec826d80712436cd5be5b26b, disabling compactions & flushes 2023-02-08 07:03:05,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:05,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:05,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. after waiting 0 ms 2023-02-08 07:03:05,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:05,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:05,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c2f1e88c1e2851f70723fd0a9ceb68e4: Waiting for close lock at 1675839785514Running coprocessor pre-close hooks at 1675839785514Disabling compacts and flushes for region at 1675839785514Disabling writes for close at 1675839785515 (+1 ms)Writing region close event to WAL at 1675839785523 (+8 ms)Running coprocessor post-close hooks at 1675839785527 (+4 ms)Closed at 1675839785528 (+1 ms) 2023-02-08 07:03:05,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:05,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 87ed579046f8447473797d6e7dbb9f5a, disabling compactions & flushes 2023-02-08 07:03:05,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:05,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:05,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. after waiting 0 ms 2023-02-08 07:03:05,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:05,535 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:05,535 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:05,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:05,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:05,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:05,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fb95ce31ec826d80712436cd5be5b26b: Waiting for close lock at 1675839785527Running coprocessor pre-close hooks at 1675839785527Disabling compacts and flushes for region at 1675839785527Disabling writes for close at 1675839785528 (+1 ms)Writing region close event to WAL at 1675839785543 (+15 ms)Running coprocessor post-close hooks at 1675839785553 (+10 ms)Closed at 1675839785554 (+1 ms) 2023-02-08 07:03:05,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:05,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 25782ea441c1f8abbf9353ed96f175a2, disabling compactions & flushes 2023-02-08 07:03:05,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. 2023-02-08 07:03:05,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. 2023-02-08 07:03:05,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. after waiting 0 ms 2023-02-08 07:03:05,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. 2023-02-08 07:03:05,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 25782ea441c1f8abbf9353ed96f175a2 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 07:03:05,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:05,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 87ed579046f8447473797d6e7dbb9f5a: Waiting for close lock at 1675839785528Running coprocessor pre-close hooks at 1675839785528Disabling compacts and flushes for region at 1675839785528Disabling writes for close at 1675839785529 (+1 ms)Writing region close event to WAL at 1675839785545 (+16 ms)Running coprocessor post-close hooks at 1675839785554 (+9 ms)Closed at 1675839785555 (+1 ms) 2023-02-08 07:03:05,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:05,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing acd414963aca9bf4723dc883c453251f, disabling compactions & flushes 2023-02-08 07:03:05,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:05,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:05,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. after waiting 0 ms 2023-02-08 07:03:05,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:05,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:05,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:05,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for acd414963aca9bf4723dc883c453251f: Waiting for close lock at 1675839785555Running coprocessor pre-close hooks at 1675839785555Disabling compacts and flushes for region at 1675839785555Disabling writes for close at 1675839785555Writing region close event to WAL at 1675839785571 (+16 ms)Running coprocessor post-close hooks at 1675839785577 (+6 ms)Closed at 1675839785577 2023-02-08 07:03:05,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:05,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2604496a73cb471eea80d0b0607a018b, disabling compactions & flushes 2023-02-08 07:03:05,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:05,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:05,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. after waiting 0 ms 2023-02-08 07:03:05,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:05,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2/.tmp/info/ff104ff43c3e478d9cff42199c752e0b 2023-02-08 07:03:05,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:05,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:05,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2604496a73cb471eea80d0b0607a018b: Waiting for close lock at 1675839785577Running coprocessor pre-close hooks at 1675839785577Disabling compacts and flushes for region at 1675839785577Disabling writes for close at 1675839785578 (+1 ms)Writing region close event to WAL at 1675839785579 (+1 ms)Running coprocessor post-close hooks at 1675839785583 (+4 ms)Closed at 1675839785584 (+1 ms) 2023-02-08 07:03:05,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:05,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5a37be146e33fe5a01ef9b4ee5891029, disabling compactions & flushes 2023-02-08 07:03:05,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:05,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:05,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. after waiting 0 ms 2023-02-08 07:03:05,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:05,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2/.tmp/info/ff104ff43c3e478d9cff42199c752e0b as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2/info/ff104ff43c3e478d9cff42199c752e0b 2023-02-08 07:03:05,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:05,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:05,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5a37be146e33fe5a01ef9b4ee5891029: Waiting for close lock at 1675839785584Running coprocessor pre-close hooks at 1675839785584Disabling compacts and flushes for region at 1675839785584Disabling writes for close at 1675839785584Writing region close event to WAL at 1675839785585 (+1 ms)Running coprocessor post-close hooks at 1675839785589 (+4 ms)Closed at 1675839785590 (+1 ms) 2023-02-08 07:03:05,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:05,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2/info/ff104ff43c3e478d9cff42199c752e0b, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 07:03:05,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 25782ea441c1f8abbf9353ed96f175a2 in 42ms, sequenceid=6, compaction requested=false 2023-02-08 07:03:05,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-08 07:03:05,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/namespace/25782ea441c1f8abbf9353ed96f175a2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 07:03:05,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. 2023-02-08 07:03:05,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 25782ea441c1f8abbf9353ed96f175a2: Waiting for close lock at 1675839785554Running coprocessor pre-close hooks at 1675839785554Disabling compacts and flushes for region at 1675839785554Disabling writes for close at 1675839785554Obtaining lock to block concurrent updates at 1675839785555 (+1 ms)Preparing flush snapshotting stores in 25782ea441c1f8abbf9353ed96f175a2 at 1675839785555Finished memstore snapshotting hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675839785555Flushing stores of hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. at 1675839785555Flushing 25782ea441c1f8abbf9353ed96f175a2/info: creating writer at 1675839785555Flushing 25782ea441c1f8abbf9353ed96f175a2/info: appending metadata at 1675839785566 (+11 ms)Flushing 25782ea441c1f8abbf9353ed96f175a2/info: closing flushed file at 1675839785566Flushing 25782ea441c1f8abbf9353ed96f175a2/info: reopening flushed file at 1675839785586 (+20 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 25782ea441c1f8abbf9353ed96f175a2 in 42ms, sequenceid=6, compaction requested=false at 1675839785596 (+10 ms)Writing region close event to WAL at 1675839785597 (+1 ms)Running coprocessor post-close hooks at 1675839785600 (+3 ms)Closed at 1675839785602 (+2 ms) 2023-02-08 07:03:05,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675839781172.25782ea441c1f8abbf9353ed96f175a2. 2023-02-08 07:03:05,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6c88256eab2776d728497dd2d0c75425, disabling compactions & flushes 2023-02-08 07:03:05,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:05,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:05,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. after waiting 0 ms 2023-02-08 07:03:05,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:05,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:05,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:05,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6c88256eab2776d728497dd2d0c75425: Waiting for close lock at 1675839785602Running coprocessor pre-close hooks at 1675839785602Disabling compacts and flushes for region at 1675839785602Disabling writes for close at 1675839785602Writing region close event to WAL at 1675839785608 (+6 ms)Running coprocessor post-close hooks at 1675839785612 (+4 ms)Closed at 1675839785612 2023-02-08 07:03:05,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:05,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2086f18794bfb36e11dcdc9164e33d77, disabling compactions & flushes 2023-02-08 07:03:05,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:05,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:05,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. after waiting 0 ms 2023-02-08 07:03:05,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:05,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 07:03:05,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:05,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2086f18794bfb36e11dcdc9164e33d77: Waiting for close lock at 1675839785612Running coprocessor pre-close hooks at 1675839785612Disabling compacts and flushes for region at 1675839785612Disabling writes for close at 1675839785612Writing region close event to WAL at 1675839785612Running coprocessor post-close hooks at 1675839785615 (+3 ms)Closed at 1675839785615 2023-02-08 07:03:05,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:05,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8e93d330f68b1c19592f63757c725102, disabling compactions & flushes 2023-02-08 07:03:05,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:05,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:05,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. after waiting 0 ms 2023-02-08 07:03:05,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:05,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:05,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:05,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8e93d330f68b1c19592f63757c725102: Waiting for close lock at 1675839785616Running coprocessor pre-close hooks at 1675839785616Disabling compacts and flushes for region at 1675839785616Disabling writes for close at 1675839785616Writing region close event to WAL at 1675839785617 (+1 ms)Running coprocessor post-close hooks at 1675839785620 (+3 ms)Closed at 1675839785620 2023-02-08 07:03:05,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:05,716 DEBUG [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 07:03:05,716 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35861,1675839780480; all regions closed. 2023-02-08 07:03:05,721 DEBUG [RS:1;jenkins-hbase4:35861] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/oldWALs 2023-02-08 07:03:05,721 INFO [RS:1;jenkins-hbase4:35861] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35861%2C1675839780480:(num 1675839781812) 2023-02-08 07:03:05,721 DEBUG [RS:1;jenkins-hbase4:35861] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:05,722 INFO [RS:1;jenkins-hbase4:35861] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:05,722 INFO [RS:1;jenkins-hbase4:35861] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 07:03:05,722 INFO [RS:1;jenkins-hbase4:35861] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:03:05,722 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:05,722 INFO [RS:1;jenkins-hbase4:35861] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:03:05,722 INFO [RS:1;jenkins-hbase4:35861] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:03:05,723 INFO [RS:1;jenkins-hbase4:35861] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35861 2023-02-08 07:03:05,726 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:05,726 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,726 ERROR [Listener at localhost/40875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d0714ee rejected from java.util.concurrent.ThreadPoolExecutor@19389396[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:05,726 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35861,1675839780480 2023-02-08 07:03:05,726 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:05,726 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:05,726 ERROR [Listener at localhost/40875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48a9da7c rejected from java.util.concurrent.ThreadPoolExecutor@19389396[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:05,728 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35861,1675839780480] 2023-02-08 07:03:05,728 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35861,1675839780480; numProcessing=1 2023-02-08 07:03:05,729 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35861,1675839780480 already deleted, retry=false 2023-02-08 07:03:05,729 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35861,1675839780480 expired; onlineServers=1 2023-02-08 07:03:05,817 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-08 07:03:05,817 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-08 07:03:05,916 DEBUG [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 07:03:05,948 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/.tmp/info/b6c5580d912d4efcba27e9f209320a34 2023-02-08 07:03:05,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/.tmp/table/4973708b09354624a7bd7ef7d160893a 2023-02-08 07:03:05,966 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/.tmp/info/b6c5580d912d4efcba27e9f209320a34 as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/info/b6c5580d912d4efcba27e9f209320a34 2023-02-08 07:03:05,971 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/info/b6c5580d912d4efcba27e9f209320a34, entries=110, sequenceid=32, filesize=18.7 K 2023-02-08 07:03:05,972 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/.tmp/table/4973708b09354624a7bd7ef7d160893a as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/table/4973708b09354624a7bd7ef7d160893a 2023-02-08 07:03:05,977 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/table/4973708b09354624a7bd7ef7d160893a, entries=4, sequenceid=32, filesize=4.8 K 2023-02-08 07:03:05,977 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 461ms, sequenceid=32, compaction requested=false 2023-02-08 07:03:05,977 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-08 07:03:05,982 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-08 07:03:05,983 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 07:03:05,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:05,983 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839785515Running coprocessor pre-close hooks at 1675839785515Disabling compacts and flushes for region at 1675839785515Disabling writes for close at 1675839785516 (+1 ms)Obtaining lock to block concurrent updates at 1675839785516Preparing flush snapshotting stores in 1588230740 at 1675839785516Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1675839785519 (+3 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675839785520 (+1 ms)Flushing 1588230740/info: creating writer at 1675839785522 (+2 ms)Flushing 1588230740/info: appending metadata at 1675839785526 (+4 ms)Flushing 1588230740/info: closing flushed file at 1675839785526Flushing 1588230740/table: creating writer at 1675839785953 (+427 ms)Flushing 1588230740/table: appending metadata at 1675839785955 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675839785955Flushing 1588230740/info: reopening flushed file at 1675839785966 (+11 ms)Flushing 1588230740/table: reopening flushed file at 1675839785972 (+6 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 461ms, sequenceid=32, compaction requested=false at 1675839785977 (+5 ms)Writing region close event to WAL at 1675839785979 (+2 ms)Running coprocessor post-close hooks at 1675839785983 (+4 ms)Closed at 1675839785983 2023-02-08 07:03:05,983 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:06,010 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:06,010 INFO [RS:1;jenkins-hbase4:35861] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35861,1675839780480; zookeeper connection closed. 2023-02-08 07:03:06,011 ERROR [Listener at localhost/40875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30559df3 rejected from java.util.concurrent.ThreadPoolExecutor@19389396[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:06,011 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@24dd951] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@24dd951 2023-02-08 07:03:06,011 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:35861-0x10032bd9ed60002, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:06,011 ERROR [Listener at localhost/40875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ae9b65e rejected from java.util.concurrent.ThreadPoolExecutor@19389396[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:06,116 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32893,1675839780408; all regions closed. 2023-02-08 07:03:06,121 DEBUG [RS:0;jenkins-hbase4:32893] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/oldWALs 2023-02-08 07:03:06,121 INFO [RS:0;jenkins-hbase4:32893] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32893%2C1675839780408.meta:.meta(num 1675839781077) 2023-02-08 07:03:06,126 DEBUG [RS:0;jenkins-hbase4:32893] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/oldWALs 2023-02-08 07:03:06,126 INFO [RS:0;jenkins-hbase4:32893] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32893%2C1675839780408:(num 1675839781545) 2023-02-08 07:03:06,126 DEBUG [RS:0;jenkins-hbase4:32893] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:06,126 INFO [RS:0;jenkins-hbase4:32893] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:06,127 INFO [RS:0;jenkins-hbase4:32893] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 07:03:06,127 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:06,127 INFO [RS:0;jenkins-hbase4:32893] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32893 2023-02-08 07:03:06,130 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32893,1675839780408 2023-02-08 07:03:06,130 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:06,130 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32893,1675839780408] 2023-02-08 07:03:06,130 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32893,1675839780408; numProcessing=2 2023-02-08 07:03:06,133 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32893,1675839780408 already deleted, retry=false 2023-02-08 07:03:06,133 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32893,1675839780408 expired; onlineServers=0 2023-02-08 07:03:06,133 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45251,1675839780181' ***** 2023-02-08 07:03:06,133 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 07:03:06,134 DEBUG [M:0;jenkins-hbase4:45251] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e9db4af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:06,134 INFO [M:0;jenkins-hbase4:45251] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45251,1675839780181 2023-02-08 07:03:06,134 INFO [M:0;jenkins-hbase4:45251] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45251,1675839780181; all regions closed. 2023-02-08 07:03:06,134 DEBUG [M:0;jenkins-hbase4:45251] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:06,134 DEBUG [M:0;jenkins-hbase4:45251] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 07:03:06,134 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 07:03:06,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839780688] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839780688,5,FailOnTimeoutGroup] 2023-02-08 07:03:06,134 DEBUG [M:0;jenkins-hbase4:45251] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 07:03:06,135 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:06,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839780688] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839780688,5,FailOnTimeoutGroup] 2023-02-08 07:03:06,135 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:06,135 INFO [M:0;jenkins-hbase4:45251] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 07:03:06,136 INFO [M:0;jenkins-hbase4:45251] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 07:03:06,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:06,136 INFO [M:0;jenkins-hbase4:45251] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 07:03:06,136 DEBUG [M:0;jenkins-hbase4:45251] master.HMaster(1502): Stopping service threads 2023-02-08 07:03:06,136 INFO [M:0;jenkins-hbase4:45251] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 07:03:06,137 ERROR [M:0;jenkins-hbase4:45251] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-08 07:03:06,137 INFO [M:0;jenkins-hbase4:45251] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 07:03:06,137 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 07:03:06,137 DEBUG [M:0;jenkins-hbase4:45251] zookeeper.ZKUtil(398): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 07:03:06,138 WARN [M:0;jenkins-hbase4:45251] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 07:03:06,138 INFO [M:0;jenkins-hbase4:45251] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 07:03:06,138 INFO [M:0;jenkins-hbase4:45251] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 07:03:06,138 DEBUG [M:0;jenkins-hbase4:45251] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:03:06,138 INFO [M:0;jenkins-hbase4:45251] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:06,138 DEBUG [M:0;jenkins-hbase4:45251] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:06,138 DEBUG [M:0;jenkins-hbase4:45251] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:03:06,138 DEBUG [M:0;jenkins-hbase4:45251] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:06,138 INFO [M:0;jenkins-hbase4:45251] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.96 KB heapSize=120.63 KB 2023-02-08 07:03:06,147 INFO [M:0;jenkins-hbase4:45251] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.96 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/972f598a247f47efbb1d523c33395e6e 2023-02-08 07:03:06,154 DEBUG [M:0;jenkins-hbase4:45251] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/972f598a247f47efbb1d523c33395e6e as hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/972f598a247f47efbb1d523c33395e6e 2023-02-08 07:03:06,159 INFO [M:0;jenkins-hbase4:45251] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/972f598a247f47efbb1d523c33395e6e, entries=31, sequenceid=218, filesize=9.0 K 2023-02-08 07:03:06,160 INFO [M:0;jenkins-hbase4:45251] regionserver.HRegion(2947): Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=218, compaction requested=false 2023-02-08 07:03:06,161 INFO [M:0;jenkins-hbase4:45251] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:06,161 DEBUG [M:0;jenkins-hbase4:45251] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839786138Disabling compacts and flushes for region at 1675839786138Disabling writes for close at 1675839786138Obtaining lock to block concurrent updates at 1675839786138Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675839786138Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103386, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1675839786139 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675839786139Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675839786140 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675839786142 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675839786142Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675839786154 (+12 ms)Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=218, compaction requested=false at 1675839786160 (+6 ms)Writing region close event to WAL at 1675839786161 (+1 ms)Closed at 1675839786161 2023-02-08 07:03:06,165 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/23d4aac4-e6d5-a3c1-13a8-a194a5d755e1/MasterData/WALs/jenkins-hbase4.apache.org,45251,1675839780181/jenkins-hbase4.apache.org%2C45251%2C1675839780181.1675839780599 not finished, retry = 0 2023-02-08 07:03:06,231 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:06,231 INFO [RS:0;jenkins-hbase4:32893] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32893,1675839780408; zookeeper connection closed. 2023-02-08 07:03:06,232 ERROR [Listener at localhost/40875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68ae9e08 rejected from java.util.concurrent.ThreadPoolExecutor@6c9107c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:06,232 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@41d5bf3a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@41d5bf3a 2023-02-08 07:03:06,232 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): regionserver:32893-0x10032bd9ed60001, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:06,232 ERROR [Listener at localhost/40875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b24970 rejected from java.util.concurrent.ThreadPoolExecutor@6c9107c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:06,232 INFO [Listener at localhost/40875] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 07:03:06,266 INFO [M:0;jenkins-hbase4:45251] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 07:03:06,266 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:06,267 INFO [M:0;jenkins-hbase4:45251] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45251 2023-02-08 07:03:06,270 DEBUG [M:0;jenkins-hbase4:45251] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45251,1675839780181 already deleted, retry=false 2023-02-08 07:03:06,371 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:06,371 INFO [M:0;jenkins-hbase4:45251] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45251,1675839780181; zookeeper connection closed. 2023-02-08 07:03:06,371 ERROR [Listener at localhost/40875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1621a48c rejected from java.util.concurrent.ThreadPoolExecutor@121e2290[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:06,372 DEBUG [Listener at localhost/40875-EventThread] zookeeper.ZKWatcher(600): master:45251-0x10032bd9ed60000, quorum=127.0.0.1:55841, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:06,372 ERROR [Listener at localhost/40875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d1f44fd rejected from java.util.concurrent.ThreadPoolExecutor@121e2290[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:06,461 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/hadoop-5447180828160313656.jar 2023-02-08 07:03:06,466 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675839783190 type: FLUSH version: 2 ttl: 0 2023-02-08 07:03:06,466 DEBUG [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce 2023-02-08 07:03:06,467 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(239): region to add: 4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:06,467 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(239): region to add: c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:06,467 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(239): region to add: 87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:06,467 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(239): region to add: fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:06,467 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(239): region to add: acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:06,468 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(239): region to add: 2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:06,468 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(239): region to add: 6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:06,468 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(239): region to add: 2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:06,468 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(239): region to add: 8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:06,468 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(239): region to add: 5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:06,468 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(585): clone region=4fc7d21cab2b5376dc37cc4929bd3e2c as 4fc7d21cab2b5376dc37cc4929bd3e2c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:06,468 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(585): clone region=c2f1e88c1e2851f70723fd0a9ceb68e4 as c2f1e88c1e2851f70723fd0a9ceb68e4 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:06,468 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(585): clone region=87ed579046f8447473797d6e7dbb9f5a as 87ed579046f8447473797d6e7dbb9f5a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:06,468 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(585): clone region=fb95ce31ec826d80712436cd5be5b26b as fb95ce31ec826d80712436cd5be5b26b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:06,469 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(585): clone region=acd414963aca9bf4723dc883c453251f as acd414963aca9bf4723dc883c453251f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:06,469 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(585): clone region=2086f18794bfb36e11dcdc9164e33d77 as 2086f18794bfb36e11dcdc9164e33d77 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:06,469 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(585): clone region=6c88256eab2776d728497dd2d0c75425 as 6c88256eab2776d728497dd2d0c75425 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:06,469 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(585): clone region=2604496a73cb471eea80d0b0607a018b as 2604496a73cb471eea80d0b0607a018b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:06,469 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(585): clone region=8e93d330f68b1c19592f63757c725102 as 8e93d330f68b1c19592f63757c725102 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:06,469 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(585): clone region=5a37be146e33fe5a01ef9b4ee5891029 as 5a37be146e33fe5a01ef9b4ee5891029 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 07:03:06,470 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4fc7d21cab2b5376dc37cc4929bd3e2c, NAME => 'testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a 2023-02-08 07:03:06,470 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => c2f1e88c1e2851f70723fd0a9ceb68e4, NAME => 'testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a 2023-02-08 07:03:06,472 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => fb95ce31ec826d80712436cd5be5b26b, NAME => 'testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a 2023-02-08 07:03:06,472 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 87ed579046f8447473797d6e7dbb9f5a, NAME => 'testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a 2023-02-08 07:03:06,473 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 2086f18794bfb36e11dcdc9164e33d77, NAME => 'testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a 2023-02-08 07:03:06,473 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => acd414963aca9bf4723dc883c453251f, NAME => 'testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a 2023-02-08 07:03:06,476 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 2604496a73cb471eea80d0b0607a018b, NAME => 'testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a 2023-02-08 07:03:06,476 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 6c88256eab2776d728497dd2d0c75425, NAME => 'testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a 2023-02-08 07:03:06,505 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:06,505 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 34b8de7f56874313b4bb94b71e20609b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,508 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:06,508 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2961dcf3a9b742c1b471e6444bd2b7bb from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,512 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:06,512 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c9301d86fd934b1c8d85d006554f63b8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,516 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:06,516 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 2086f18794bfb36e11dcdc9164e33d77, disabling compactions & flushes 2023-02-08 07:03:06,516 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:06,516 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:06,516 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. after waiting 0 ms 2023-02-08 07:03:06,516 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:06,516 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:06,516 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 2086f18794bfb36e11dcdc9164e33d77: Waiting for close lock at 1675839786516Disabling compacts and flushes for region at 1675839786516Disabling writes for close at 1675839786516Writing region close event to WAL at 1675839786516Closed at 1675839786516 2023-02-08 07:03:06,517 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 8e93d330f68b1c19592f63757c725102, NAME => 'testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a 2023-02-08 07:03:06,524 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9c76f229559c48d590459187078922bf from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,524 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:06,525 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4fc7d21cab2b5376dc37cc4929bd3e2c, disabling compactions & flushes 2023-02-08 07:03:06,525 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:06,525 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:06,525 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. after waiting 0 ms 2023-02-08 07:03:06,525 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 51005b340e3d4f9983dbb05f670bfe30 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,525 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:06,525 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:06,525 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4fc7d21cab2b5376dc37cc4929bd3e2c: Waiting for close lock at 1675839786525Disabling compacts and flushes for region at 1675839786525Disabling writes for close at 1675839786525Writing region close event to WAL at 1675839786525Closed at 1675839786525 2023-02-08 07:03:06,525 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 59dff5ad79e54816a35d286dca395125 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,526 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5a37be146e33fe5a01ef9b4ee5891029, NAME => 'testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a 2023-02-08 07:03:06,529 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:06,529 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:06,529 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1978abbd04d947a88b1adf3bd988375e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,529 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f1173d0dc2994bdcbd06f4a0c6640c66 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,529 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing c2f1e88c1e2851f70723fd0a9ceb68e4, disabling compactions & flushes 2023-02-08 07:03:06,530 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:06,530 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:06,530 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. after waiting 0 ms 2023-02-08 07:03:06,530 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:06,530 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:06,530 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for c2f1e88c1e2851f70723fd0a9ceb68e4: Waiting for close lock at 1675839786529Disabling compacts and flushes for region at 1675839786529Disabling writes for close at 1675839786530 (+1 ms)Writing region close event to WAL at 1675839786530Closed at 1675839786530 2023-02-08 07:03:06,533 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 2604496a73cb471eea80d0b0607a018b, disabling compactions & flushes 2023-02-08 07:03:06,533 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:06,534 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:06,534 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. after waiting 0 ms 2023-02-08 07:03:06,534 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:06,534 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:06,534 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 2604496a73cb471eea80d0b0607a018b: Waiting for close lock at 1675839786533Disabling compacts and flushes for region at 1675839786533Disabling writes for close at 1675839786534 (+1 ms)Writing region close event to WAL at 1675839786534Closed at 1675839786534 2023-02-08 07:03:06,537 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing acd414963aca9bf4723dc883c453251f, disabling compactions & flushes 2023-02-08 07:03:06,537 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:06,537 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:06,537 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. after waiting 0 ms 2023-02-08 07:03:06,538 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:06,538 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:06,538 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for acd414963aca9bf4723dc883c453251f: Waiting for close lock at 1675839786537Disabling compacts and flushes for region at 1675839786537Disabling writes for close at 1675839786538 (+1 ms)Writing region close event to WAL at 1675839786538Closed at 1675839786538 2023-02-08 07:03:06,539 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7ee67342a680425880b3f408a7f942a7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,540 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:06,540 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink af274e8cbbd54be9a525474d0bd0acfe from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,542 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 6c88256eab2776d728497dd2d0c75425, disabling compactions & flushes 2023-02-08 07:03:06,542 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:06,542 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:06,542 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. after waiting 0 ms 2023-02-08 07:03:06,542 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:06,542 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:06,542 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 6c88256eab2776d728497dd2d0c75425: Waiting for close lock at 1675839786542Disabling compacts and flushes for region at 1675839786542Disabling writes for close at 1675839786542Writing region close event to WAL at 1675839786542Closed at 1675839786542 2023-02-08 07:03:06,542 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d293b32d05654df19765c3070e09183c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,544 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ee165eb555fd42648d18dc347b6810d4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,544 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 8e93d330f68b1c19592f63757c725102, disabling compactions & flushes 2023-02-08 07:03:06,544 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:06,544 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:06,544 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. after waiting 0 ms 2023-02-08 07:03:06,544 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:06,544 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:06,544 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 8e93d330f68b1c19592f63757c725102: Waiting for close lock at 1675839786544Disabling compacts and flushes for region at 1675839786544Disabling writes for close at 1675839786544Writing region close event to WAL at 1675839786544Closed at 1675839786544 2023-02-08 07:03:06,546 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 87ed579046f8447473797d6e7dbb9f5a, disabling compactions & flushes 2023-02-08 07:03:06,546 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:06,546 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:06,546 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. after waiting 0 ms 2023-02-08 07:03:06,546 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:06,546 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:06,546 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 87ed579046f8447473797d6e7dbb9f5a: Waiting for close lock at 1675839786546Disabling compacts and flushes for region at 1675839786546Disabling writes for close at 1675839786546Writing region close event to WAL at 1675839786546Closed at 1675839786546 2023-02-08 07:03:06,547 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:06,547 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 17be0ba7e6564a7b95fe119da6bebeff from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,549 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 568a21ff12d449cb820c5facd1084f9c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,551 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 5a37be146e33fe5a01ef9b4ee5891029, disabling compactions & flushes 2023-02-08 07:03:06,551 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:06,551 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:06,551 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. after waiting 0 ms 2023-02-08 07:03:06,551 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:06,551 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:06,551 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 5a37be146e33fe5a01ef9b4ee5891029: Waiting for close lock at 1675839786551Disabling compacts and flushes for region at 1675839786551Disabling writes for close at 1675839786551Writing region close event to WAL at 1675839786551Closed at 1675839786551 2023-02-08 07:03:06,928 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:06,929 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e2834469877549cb8e0f2b0eed0aa37f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,931 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a89fc29eaa2b4c5585071f76a72fa445 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 07:03:06,933 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing fb95ce31ec826d80712436cd5be5b26b, disabling compactions & flushes 2023-02-08 07:03:06,933 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:06,934 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:06,934 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. after waiting 0 ms 2023-02-08 07:03:06,934 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:06,934 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:06,934 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for fb95ce31ec826d80712436cd5be5b26b: Waiting for close lock at 1675839786933Disabling compacts and flushes for region at 1675839786933Disabling writes for close at 1675839786934 (+1 ms)Writing region close event to WAL at 1675839786934Closed at 1675839786934 2023-02-08 07:03:06,934 INFO [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675839783190 type: FLUSH version: 2 ttl: 0 2023-02-08 07:03:06,934 DEBUG [Listener at localhost/40875] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a 2023-02-08 07:03:06,934 DEBUG [Listener at localhost/40875] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a 2023-02-08 07:03:06,935 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-data/ 2023-02-08 07:03:06,935 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |----default/ 2023-02-08 07:03:06,936 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-08 07:03:06,936 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |----------2086f18794bfb36e11dcdc9164e33d77/ 2023-02-08 07:03:06,937 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:06,937 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |----------2604496a73cb471eea80d0b0607a018b/ 2023-02-08 07:03:06,937 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:06,938 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:06,938 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=2604496a73cb471eea80d0b0607a018b-34b8de7f56874313b4bb94b71e20609b 2023-02-08 07:03:06,938 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:06,939 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=2604496a73cb471eea80d0b0607a018b-9c76f229559c48d590459187078922bf 2023-02-08 07:03:06,939 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |----------4fc7d21cab2b5376dc37cc4929bd3e2c/ 2023-02-08 07:03:06,939 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:06,939 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |----------5a37be146e33fe5a01ef9b4ee5891029/ 2023-02-08 07:03:06,940 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:06,940 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:06,940 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=5a37be146e33fe5a01ef9b4ee5891029-17be0ba7e6564a7b95fe119da6bebeff 2023-02-08 07:03:06,940 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:06,941 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=5a37be146e33fe5a01ef9b4ee5891029-568a21ff12d449cb820c5facd1084f9c 2023-02-08 07:03:06,941 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |----------6c88256eab2776d728497dd2d0c75425/ 2023-02-08 07:03:06,941 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:06,942 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:06,942 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=6c88256eab2776d728497dd2d0c75425-1978abbd04d947a88b1adf3bd988375e 2023-02-08 07:03:06,942 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:06,943 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=6c88256eab2776d728497dd2d0c75425-7ee67342a680425880b3f408a7f942a7 2023-02-08 07:03:06,943 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |----------87ed579046f8447473797d6e7dbb9f5a/ 2023-02-08 07:03:06,943 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:06,943 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:06,944 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=87ed579046f8447473797d6e7dbb9f5a-f1173d0dc2994bdcbd06f4a0c6640c66 2023-02-08 07:03:06,944 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:06,944 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=87ed579046f8447473797d6e7dbb9f5a-ee165eb555fd42648d18dc347b6810d4 2023-02-08 07:03:06,944 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |----------8e93d330f68b1c19592f63757c725102/ 2023-02-08 07:03:06,945 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:06,945 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:06,946 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=8e93d330f68b1c19592f63757c725102-af274e8cbbd54be9a525474d0bd0acfe 2023-02-08 07:03:06,946 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:06,946 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=8e93d330f68b1c19592f63757c725102-d293b32d05654df19765c3070e09183c 2023-02-08 07:03:06,946 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |----------acd414963aca9bf4723dc883c453251f/ 2023-02-08 07:03:06,947 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:06,947 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:06,947 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=acd414963aca9bf4723dc883c453251f-c9301d86fd934b1c8d85d006554f63b8 2023-02-08 07:03:06,947 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:06,948 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=acd414963aca9bf4723dc883c453251f-59dff5ad79e54816a35d286dca395125 2023-02-08 07:03:06,948 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |----------c2f1e88c1e2851f70723fd0a9ceb68e4/ 2023-02-08 07:03:06,948 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:06,949 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:06,949 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=c2f1e88c1e2851f70723fd0a9ceb68e4-2961dcf3a9b742c1b471e6444bd2b7bb 2023-02-08 07:03:06,949 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:06,950 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=c2f1e88c1e2851f70723fd0a9ceb68e4-51005b340e3d4f9983dbb05f670bfe30 2023-02-08 07:03:06,950 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |----------fb95ce31ec826d80712436cd5be5b26b/ 2023-02-08 07:03:06,950 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:06,950 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:06,951 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=fb95ce31ec826d80712436cd5be5b26b-e2834469877549cb8e0f2b0eed0aa37f 2023-02-08 07:03:06,951 DEBUG [Listener at localhost/40875] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:06,951 DEBUG [Listener at localhost/40875] util.CommonFSUtils(702): |----------------testWithMapReduce=fb95ce31ec826d80712436cd5be5b26b-a89fc29eaa2b4c5585071f76a72fa445 2023-02-08 07:03:06,952 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:06,952 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:06,953 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:06,954 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:06,954 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:06,955 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:06,955 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:07,025 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/hadoop-6688881695951340144.jar 2023-02-08 07:03:07,025 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:07,026 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:07,026 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:07,026 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:07,027 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:07,027 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:07,027 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-08 07:03:07,028 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-08 07:03:07,028 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-08 07:03:07,029 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-08 07:03:07,029 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-08 07:03:07,029 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-08 07:03:07,030 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-08 07:03:07,030 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-08 07:03:07,030 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-08 07:03:07,031 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-08 07:03:07,031 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:07,031 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 07:03:07,032 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 07:03:07,032 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 07:03:07,032 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-08 07:03:07,098 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/hadoop-79405750542296791.jar 2023-02-08 07:03:07,099 DEBUG [Listener at localhost/40875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-08 07:03:07,104 WARN [Listener at localhost/40875] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-08 07:03:07,134 INFO [Listener at localhost/40875] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-08 07:03:07,232 WARN [Listener at localhost/40875] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/mapreduce.cluster.local.dir/1675839787199/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-08 07:03:07,232 WARN [Listener at localhost/40875] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/mapreduce.cluster.local.dir/1675839787199/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-08 07:03:07,272 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:07,272 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:07,276 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:07,278 INFO [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:07,280 DEBUG [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77/f1 2023-02-08 07:03:07,280 INFO [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2086f18794bfb36e11dcdc9164e33d77 columnFamilyName f1 2023-02-08 07:03:07,281 INFO [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] regionserver.HStore(310): Store=2086f18794bfb36e11dcdc9164e33d77/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,281 INFO [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2086f18794bfb36e11dcdc9164e33d77 2023-02-08 07:03:07,283 DEBUG [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/2086f18794bfb36e11dcdc9164e33d77/f2 2023-02-08 07:03:07,283 INFO [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2086f18794bfb36e11dcdc9164e33d77 columnFamilyName f2 2023-02-08 07:03:07,284 INFO [StoreOpener-2086f18794bfb36e11dcdc9164e33d77-1] regionserver.HStore(310): Store=2086f18794bfb36e11dcdc9164e33d77/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,284 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:07,284 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2086f18794bfb36e11dcdc9164e33d77; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73234378, jitterRate=0.09127727150917053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:07,284 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2086f18794bfb36e11dcdc9164e33d77: Writing region info on filesystem at 1675839787276Initializing all the Stores at 1675839787278 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787278Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787278Region opened successfully at 1675839787284 (+6 ms) 2023-02-08 07:03:07,302 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2086f18794bfb36e11dcdc9164e33d77, disabling compactions & flushes 2023-02-08 07:03:07,302 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:07,302 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:07,302 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. after waiting 0 ms 2023-02-08 07:03:07,302 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:07,303 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675839781850.2086f18794bfb36e11dcdc9164e33d77. 2023-02-08 07:03:07,303 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2086f18794bfb36e11dcdc9164e33d77: Waiting for close lock at 1675839787302Disabling compacts and flushes for region at 1675839787302Disabling writes for close at 1675839787302Writing region close event to WAL at 1675839787303 (+1 ms)Closed at 1675839787303 2023-02-08 07:03:07,308 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:07,308 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:07,310 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:07,312 INFO [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:07,313 DEBUG [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f1 2023-02-08 07:03:07,313 INFO [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2604496a73cb471eea80d0b0607a018b columnFamilyName f1 2023-02-08 07:03:07,318 DEBUG [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f1/testWithMapReduce=2604496a73cb471eea80d0b0607a018b-34b8de7f56874313b4bb94b71e20609b 2023-02-08 07:03:07,319 INFO [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] regionserver.HStore(310): Store=2604496a73cb471eea80d0b0607a018b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,319 INFO [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2604496a73cb471eea80d0b0607a018b 2023-02-08 07:03:07,320 DEBUG [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f2 2023-02-08 07:03:07,320 INFO [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2604496a73cb471eea80d0b0607a018b columnFamilyName f2 2023-02-08 07:03:07,325 DEBUG [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/2604496a73cb471eea80d0b0607a018b/f2/testWithMapReduce=2604496a73cb471eea80d0b0607a018b-9c76f229559c48d590459187078922bf 2023-02-08 07:03:07,326 INFO [StoreOpener-2604496a73cb471eea80d0b0607a018b-1] regionserver.HStore(310): Store=2604496a73cb471eea80d0b0607a018b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,326 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:07,326 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2604496a73cb471eea80d0b0607a018b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63490314, jitterRate=-0.053920596837997437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:07,326 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2604496a73cb471eea80d0b0607a018b: Writing region info on filesystem at 1675839787310Initializing all the Stores at 1675839787311 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787311Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787311Region opened successfully at 1675839787326 (+15 ms) 2023-02-08 07:03:07,363 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2604496a73cb471eea80d0b0607a018b, disabling compactions & flushes 2023-02-08 07:03:07,363 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:07,363 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:07,363 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. after waiting 0 ms 2023-02-08 07:03:07,363 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:07,364 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675839781850.2604496a73cb471eea80d0b0607a018b. 2023-02-08 07:03:07,364 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2604496a73cb471eea80d0b0607a018b: Waiting for close lock at 1675839787363Disabling compacts and flushes for region at 1675839787363Disabling writes for close at 1675839787363Writing region close event to WAL at 1675839787364 (+1 ms)Closed at 1675839787364 2023-02-08 07:03:07,367 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:07,367 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:07,369 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:07,370 INFO [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:07,372 DEBUG [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c/f1 2023-02-08 07:03:07,372 INFO [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fc7d21cab2b5376dc37cc4929bd3e2c columnFamilyName f1 2023-02-08 07:03:07,372 INFO [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] regionserver.HStore(310): Store=4fc7d21cab2b5376dc37cc4929bd3e2c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,373 INFO [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fc7d21cab2b5376dc37cc4929bd3e2c 2023-02-08 07:03:07,374 DEBUG [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/4fc7d21cab2b5376dc37cc4929bd3e2c/f2 2023-02-08 07:03:07,374 INFO [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fc7d21cab2b5376dc37cc4929bd3e2c columnFamilyName f2 2023-02-08 07:03:07,374 INFO [StoreOpener-4fc7d21cab2b5376dc37cc4929bd3e2c-1] regionserver.HStore(310): Store=4fc7d21cab2b5376dc37cc4929bd3e2c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:07,375 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4fc7d21cab2b5376dc37cc4929bd3e2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65882832, jitterRate=-0.01826930046081543}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:07,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4fc7d21cab2b5376dc37cc4929bd3e2c: Writing region info on filesystem at 1675839787369Initializing all the Stores at 1675839787369Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787369Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787370 (+1 ms)Region opened successfully at 1675839787375 (+5 ms) 2023-02-08 07:03:07,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4fc7d21cab2b5376dc37cc4929bd3e2c, disabling compactions & flushes 2023-02-08 07:03:07,392 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:07,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:07,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. after waiting 0 ms 2023-02-08 07:03:07,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:07,392 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675839781850.4fc7d21cab2b5376dc37cc4929bd3e2c. 2023-02-08 07:03:07,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4fc7d21cab2b5376dc37cc4929bd3e2c: Waiting for close lock at 1675839787392Disabling compacts and flushes for region at 1675839787392Disabling writes for close at 1675839787392Writing region close event to WAL at 1675839787392Closed at 1675839787392 2023-02-08 07:03:07,395 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:07,395 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:07,398 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:07,400 INFO [StoreOpener-8e93d330f68b1c19592f63757c725102-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:07,401 DEBUG [StoreOpener-8e93d330f68b1c19592f63757c725102-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f1 2023-02-08 07:03:07,401 INFO [StoreOpener-8e93d330f68b1c19592f63757c725102-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e93d330f68b1c19592f63757c725102 columnFamilyName f1 2023-02-08 07:03:07,406 DEBUG [StoreOpener-8e93d330f68b1c19592f63757c725102-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f1/testWithMapReduce=8e93d330f68b1c19592f63757c725102-af274e8cbbd54be9a525474d0bd0acfe 2023-02-08 07:03:07,406 INFO [StoreOpener-8e93d330f68b1c19592f63757c725102-1] regionserver.HStore(310): Store=8e93d330f68b1c19592f63757c725102/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,406 INFO [StoreOpener-8e93d330f68b1c19592f63757c725102-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8e93d330f68b1c19592f63757c725102 2023-02-08 07:03:07,407 DEBUG [StoreOpener-8e93d330f68b1c19592f63757c725102-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f2 2023-02-08 07:03:07,408 INFO [StoreOpener-8e93d330f68b1c19592f63757c725102-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e93d330f68b1c19592f63757c725102 columnFamilyName f2 2023-02-08 07:03:07,413 DEBUG [StoreOpener-8e93d330f68b1c19592f63757c725102-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/8e93d330f68b1c19592f63757c725102/f2/testWithMapReduce=8e93d330f68b1c19592f63757c725102-d293b32d05654df19765c3070e09183c 2023-02-08 07:03:07,413 INFO [StoreOpener-8e93d330f68b1c19592f63757c725102-1] regionserver.HStore(310): Store=8e93d330f68b1c19592f63757c725102/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,413 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:07,413 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8e93d330f68b1c19592f63757c725102; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61836256, jitterRate=-0.0785679817199707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:07,413 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8e93d330f68b1c19592f63757c725102: Writing region info on filesystem at 1675839787398Initializing all the Stores at 1675839787399 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787399Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787399Region opened successfully at 1675839787413 (+14 ms) 2023-02-08 07:03:07,460 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8e93d330f68b1c19592f63757c725102, disabling compactions & flushes 2023-02-08 07:03:07,460 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:07,460 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:07,461 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. after waiting 0 ms 2023-02-08 07:03:07,461 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:07,463 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675839781850.8e93d330f68b1c19592f63757c725102. 2023-02-08 07:03:07,463 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8e93d330f68b1c19592f63757c725102: Waiting for close lock at 1675839787459Disabling compacts and flushes for region at 1675839787459Disabling writes for close at 1675839787461 (+2 ms)Writing region close event to WAL at 1675839787463 (+2 ms)Closed at 1675839787463 2023-02-08 07:03:07,467 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:07,467 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:07,470 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:07,472 INFO [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:07,473 DEBUG [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f1 2023-02-08 07:03:07,473 INFO [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a37be146e33fe5a01ef9b4ee5891029 columnFamilyName f1 2023-02-08 07:03:07,478 DEBUG [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f1/testWithMapReduce=5a37be146e33fe5a01ef9b4ee5891029-17be0ba7e6564a7b95fe119da6bebeff 2023-02-08 07:03:07,478 INFO [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] regionserver.HStore(310): Store=5a37be146e33fe5a01ef9b4ee5891029/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,478 INFO [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5a37be146e33fe5a01ef9b4ee5891029 2023-02-08 07:03:07,479 DEBUG [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f2 2023-02-08 07:03:07,480 INFO [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a37be146e33fe5a01ef9b4ee5891029 columnFamilyName f2 2023-02-08 07:03:07,485 DEBUG [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/5a37be146e33fe5a01ef9b4ee5891029/f2/testWithMapReduce=5a37be146e33fe5a01ef9b4ee5891029-568a21ff12d449cb820c5facd1084f9c 2023-02-08 07:03:07,485 INFO [StoreOpener-5a37be146e33fe5a01ef9b4ee5891029-1] regionserver.HStore(310): Store=5a37be146e33fe5a01ef9b4ee5891029/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,485 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:07,485 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5a37be146e33fe5a01ef9b4ee5891029; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60499739, jitterRate=-0.09848363697528839}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:07,485 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5a37be146e33fe5a01ef9b4ee5891029: Writing region info on filesystem at 1675839787470Initializing all the Stores at 1675839787471 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787471Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787471Region opened successfully at 1675839787485 (+14 ms) 2023-02-08 07:03:07,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5a37be146e33fe5a01ef9b4ee5891029, disabling compactions & flushes 2023-02-08 07:03:07,514 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:07,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:07,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. after waiting 0 ms 2023-02-08 07:03:07,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:07,515 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675839781850.5a37be146e33fe5a01ef9b4ee5891029. 2023-02-08 07:03:07,515 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5a37be146e33fe5a01ef9b4ee5891029: Waiting for close lock at 1675839787513Disabling compacts and flushes for region at 1675839787513Disabling writes for close at 1675839787514 (+1 ms)Writing region close event to WAL at 1675839787515 (+1 ms)Closed at 1675839787515 2023-02-08 07:03:07,519 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:07,519 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:07,524 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:07,525 INFO [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:07,526 DEBUG [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f1 2023-02-08 07:03:07,527 INFO [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ed579046f8447473797d6e7dbb9f5a columnFamilyName f1 2023-02-08 07:03:07,531 DEBUG [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f1/testWithMapReduce=87ed579046f8447473797d6e7dbb9f5a-f1173d0dc2994bdcbd06f4a0c6640c66 2023-02-08 07:03:07,531 INFO [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] regionserver.HStore(310): Store=87ed579046f8447473797d6e7dbb9f5a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,531 INFO [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87ed579046f8447473797d6e7dbb9f5a 2023-02-08 07:03:07,532 DEBUG [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f2 2023-02-08 07:03:07,532 INFO [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ed579046f8447473797d6e7dbb9f5a columnFamilyName f2 2023-02-08 07:03:07,536 DEBUG [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/87ed579046f8447473797d6e7dbb9f5a/f2/testWithMapReduce=87ed579046f8447473797d6e7dbb9f5a-ee165eb555fd42648d18dc347b6810d4 2023-02-08 07:03:07,536 INFO [StoreOpener-87ed579046f8447473797d6e7dbb9f5a-1] regionserver.HStore(310): Store=87ed579046f8447473797d6e7dbb9f5a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,537 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:07,537 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 87ed579046f8447473797d6e7dbb9f5a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59732097, jitterRate=-0.109922394156456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:07,537 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 87ed579046f8447473797d6e7dbb9f5a: Writing region info on filesystem at 1675839787524Initializing all the Stores at 1675839787525 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787525Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787525Region opened successfully at 1675839787537 (+12 ms) 2023-02-08 07:03:07,567 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 87ed579046f8447473797d6e7dbb9f5a, disabling compactions & flushes 2023-02-08 07:03:07,567 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:07,567 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:07,567 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. after waiting 0 ms 2023-02-08 07:03:07,567 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:07,568 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675839781850.87ed579046f8447473797d6e7dbb9f5a. 2023-02-08 07:03:07,568 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 87ed579046f8447473797d6e7dbb9f5a: Waiting for close lock at 1675839787567Disabling compacts and flushes for region at 1675839787567Disabling writes for close at 1675839787567Writing region close event to WAL at 1675839787568 (+1 ms)Closed at 1675839787568 2023-02-08 07:03:07,571 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:07,571 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:07,572 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:07,574 INFO [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:07,575 DEBUG [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f1 2023-02-08 07:03:07,575 INFO [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb95ce31ec826d80712436cd5be5b26b columnFamilyName f1 2023-02-08 07:03:07,580 DEBUG [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f1/testWithMapReduce=fb95ce31ec826d80712436cd5be5b26b-e2834469877549cb8e0f2b0eed0aa37f 2023-02-08 07:03:07,580 INFO [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] regionserver.HStore(310): Store=fb95ce31ec826d80712436cd5be5b26b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,581 INFO [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fb95ce31ec826d80712436cd5be5b26b 2023-02-08 07:03:07,582 DEBUG [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f2 2023-02-08 07:03:07,582 INFO [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb95ce31ec826d80712436cd5be5b26b columnFamilyName f2 2023-02-08 07:03:07,586 DEBUG [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/fb95ce31ec826d80712436cd5be5b26b/f2/testWithMapReduce=fb95ce31ec826d80712436cd5be5b26b-a89fc29eaa2b4c5585071f76a72fa445 2023-02-08 07:03:07,586 INFO [StoreOpener-fb95ce31ec826d80712436cd5be5b26b-1] regionserver.HStore(310): Store=fb95ce31ec826d80712436cd5be5b26b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,586 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:07,586 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fb95ce31ec826d80712436cd5be5b26b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60159177, jitterRate=-0.10355840623378754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:07,586 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fb95ce31ec826d80712436cd5be5b26b: Writing region info on filesystem at 1675839787572Initializing all the Stores at 1675839787573 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787573Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787573Region opened successfully at 1675839787586 (+13 ms) 2023-02-08 07:03:07,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fb95ce31ec826d80712436cd5be5b26b, disabling compactions & flushes 2023-02-08 07:03:07,613 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:07,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:07,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. after waiting 0 ms 2023-02-08 07:03:07,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:07,614 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675839781850.fb95ce31ec826d80712436cd5be5b26b. 2023-02-08 07:03:07,614 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fb95ce31ec826d80712436cd5be5b26b: Waiting for close lock at 1675839787613Disabling compacts and flushes for region at 1675839787613Disabling writes for close at 1675839787613Writing region close event to WAL at 1675839787614 (+1 ms)Closed at 1675839787614 2023-02-08 07:03:07,618 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:07,618 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:07,621 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:07,623 INFO [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:07,624 DEBUG [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f1 2023-02-08 07:03:07,624 INFO [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c88256eab2776d728497dd2d0c75425 columnFamilyName f1 2023-02-08 07:03:07,629 DEBUG [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f1/testWithMapReduce=6c88256eab2776d728497dd2d0c75425-1978abbd04d947a88b1adf3bd988375e 2023-02-08 07:03:07,629 INFO [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] regionserver.HStore(310): Store=6c88256eab2776d728497dd2d0c75425/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,629 INFO [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6c88256eab2776d728497dd2d0c75425 2023-02-08 07:03:07,630 DEBUG [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f2 2023-02-08 07:03:07,631 INFO [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c88256eab2776d728497dd2d0c75425 columnFamilyName f2 2023-02-08 07:03:07,636 DEBUG [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/6c88256eab2776d728497dd2d0c75425/f2/testWithMapReduce=6c88256eab2776d728497dd2d0c75425-7ee67342a680425880b3f408a7f942a7 2023-02-08 07:03:07,636 INFO [StoreOpener-6c88256eab2776d728497dd2d0c75425-1] regionserver.HStore(310): Store=6c88256eab2776d728497dd2d0c75425/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,636 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:07,636 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6c88256eab2776d728497dd2d0c75425; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75408076, jitterRate=0.1236678957939148}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:07,636 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6c88256eab2776d728497dd2d0c75425: Writing region info on filesystem at 1675839787621Initializing all the Stores at 1675839787622 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787622Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787622Region opened successfully at 1675839787636 (+14 ms) 2023-02-08 07:03:07,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6c88256eab2776d728497dd2d0c75425, disabling compactions & flushes 2023-02-08 07:03:07,666 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:07,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:07,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. after waiting 0 ms 2023-02-08 07:03:07,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:07,768 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675839781850.6c88256eab2776d728497dd2d0c75425. 2023-02-08 07:03:07,768 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6c88256eab2776d728497dd2d0c75425: Waiting for close lock at 1675839787666Disabling compacts and flushes for region at 1675839787666Disabling writes for close at 1675839787666Writing region close event to WAL at 1675839787768 (+102 ms)Closed at 1675839787768 2023-02-08 07:03:07,777 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:07,777 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:07,781 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:07,783 INFO [StoreOpener-acd414963aca9bf4723dc883c453251f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:07,784 DEBUG [StoreOpener-acd414963aca9bf4723dc883c453251f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f1 2023-02-08 07:03:07,784 INFO [StoreOpener-acd414963aca9bf4723dc883c453251f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acd414963aca9bf4723dc883c453251f columnFamilyName f1 2023-02-08 07:03:07,793 DEBUG [StoreOpener-acd414963aca9bf4723dc883c453251f-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f1/testWithMapReduce=acd414963aca9bf4723dc883c453251f-c9301d86fd934b1c8d85d006554f63b8 2023-02-08 07:03:07,793 INFO [StoreOpener-acd414963aca9bf4723dc883c453251f-1] regionserver.HStore(310): Store=acd414963aca9bf4723dc883c453251f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,793 INFO [StoreOpener-acd414963aca9bf4723dc883c453251f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region acd414963aca9bf4723dc883c453251f 2023-02-08 07:03:07,794 DEBUG [StoreOpener-acd414963aca9bf4723dc883c453251f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f2 2023-02-08 07:03:07,794 INFO [StoreOpener-acd414963aca9bf4723dc883c453251f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acd414963aca9bf4723dc883c453251f columnFamilyName f2 2023-02-08 07:03:07,800 DEBUG [StoreOpener-acd414963aca9bf4723dc883c453251f-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/acd414963aca9bf4723dc883c453251f/f2/testWithMapReduce=acd414963aca9bf4723dc883c453251f-59dff5ad79e54816a35d286dca395125 2023-02-08 07:03:07,800 INFO [StoreOpener-acd414963aca9bf4723dc883c453251f-1] regionserver.HStore(310): Store=acd414963aca9bf4723dc883c453251f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,801 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:07,801 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened acd414963aca9bf4723dc883c453251f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60331592, jitterRate=-0.10098922252655029}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:07,801 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for acd414963aca9bf4723dc883c453251f: Writing region info on filesystem at 1675839787781Initializing all the Stores at 1675839787782 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787782Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787782Region opened successfully at 1675839787801 (+19 ms) 2023-02-08 07:03:07,828 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing acd414963aca9bf4723dc883c453251f, disabling compactions & flushes 2023-02-08 07:03:07,828 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:07,828 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:07,828 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. after waiting 0 ms 2023-02-08 07:03:07,828 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:07,829 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675839781850.acd414963aca9bf4723dc883c453251f. 2023-02-08 07:03:07,829 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for acd414963aca9bf4723dc883c453251f: Waiting for close lock at 1675839787828Disabling compacts and flushes for region at 1675839787828Disabling writes for close at 1675839787828Writing region close event to WAL at 1675839787829 (+1 ms)Closed at 1675839787829 2023-02-08 07:03:07,831 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:07,831 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:07,833 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:07,835 INFO [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:07,836 DEBUG [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f1 2023-02-08 07:03:07,836 INFO [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2f1e88c1e2851f70723fd0a9ceb68e4 columnFamilyName f1 2023-02-08 07:03:07,841 DEBUG [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f1/testWithMapReduce=c2f1e88c1e2851f70723fd0a9ceb68e4-2961dcf3a9b742c1b471e6444bd2b7bb 2023-02-08 07:03:07,841 INFO [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] regionserver.HStore(310): Store=c2f1e88c1e2851f70723fd0a9ceb68e4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,841 INFO [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c2f1e88c1e2851f70723fd0a9ceb68e4 2023-02-08 07:03:07,842 DEBUG [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f2 2023-02-08 07:03:07,842 INFO [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2f1e88c1e2851f70723fd0a9ceb68e4 columnFamilyName f2 2023-02-08 07:03:07,847 DEBUG [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/4eaef15d-5368-f184-1597-d5b74659ba64/testWithMapReduceAndOfflineHBaseMultiRegion/bdbc314c-9428-49ff-a3d3-3d82f4b6985a/data/default/testWithMapReduce/c2f1e88c1e2851f70723fd0a9ceb68e4/f2/testWithMapReduce=c2f1e88c1e2851f70723fd0a9ceb68e4-51005b340e3d4f9983dbb05f670bfe30 2023-02-08 07:03:07,847 INFO [StoreOpener-c2f1e88c1e2851f70723fd0a9ceb68e4-1] regionserver.HStore(310): Store=c2f1e88c1e2851f70723fd0a9ceb68e4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:07,847 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:07,848 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c2f1e88c1e2851f70723fd0a9ceb68e4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67539096, jitterRate=0.006410956382751465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:07,848 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c2f1e88c1e2851f70723fd0a9ceb68e4: Writing region info on filesystem at 1675839787833Initializing all the Stores at 1675839787833Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787833Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839787834 (+1 ms)Region opened successfully at 1675839787848 (+14 ms) 2023-02-08 07:03:07,877 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c2f1e88c1e2851f70723fd0a9ceb68e4, disabling compactions & flushes 2023-02-08 07:03:07,877 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:07,877 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:07,877 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. after waiting 0 ms 2023-02-08 07:03:07,877 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:07,878 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675839781850.c2f1e88c1e2851f70723fd0a9ceb68e4. 2023-02-08 07:03:07,878 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c2f1e88c1e2851f70723fd0a9ceb68e4: Waiting for close lock at 1675839787877Disabling compacts and flushes for region at 1675839787877Disabling writes for close at 1675839787877Writing region close event to WAL at 1675839787878 (+1 ms)Closed at 1675839787878 2023-02-08 07:03:08,267 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-08 07:03:08,273 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 07:03:08,273 WARN [Listener at localhost/40875] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:03:08,281 INFO [Listener at localhost/40875] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:08,386 WARN [BP-841800232-172.31.14.131-1675839779404 heartbeating to localhost/127.0.0.1:39907] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:03:08,386 WARN [BP-841800232-172.31.14.131-1675839779404 heartbeating to localhost/127.0.0.1:39907] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-841800232-172.31.14.131-1675839779404 (Datanode Uuid ffcaf2ef-1c97-441c-9235-fe4e84b04f70) service to localhost/127.0.0.1:39907 2023-02-08 07:03:08,387 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/cluster_98ed82c7-d295-0ba7-07a2-91bfd72c9573/dfs/data/data3/current/BP-841800232-172.31.14.131-1675839779404] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:08,387 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/cluster_98ed82c7-d295-0ba7-07a2-91bfd72c9573/dfs/data/data4/current/BP-841800232-172.31.14.131-1675839779404] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:08,389 WARN [Listener at localhost/40875] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:03:08,392 INFO [Listener at localhost/40875] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:08,494 WARN [BP-841800232-172.31.14.131-1675839779404 heartbeating to localhost/127.0.0.1:39907] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:03:08,494 WARN [BP-841800232-172.31.14.131-1675839779404 heartbeating to localhost/127.0.0.1:39907] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-841800232-172.31.14.131-1675839779404 (Datanode Uuid 1bdac5db-144a-4afa-81f1-3bacbba38751) service to localhost/127.0.0.1:39907 2023-02-08 07:03:08,495 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/cluster_98ed82c7-d295-0ba7-07a2-91bfd72c9573/dfs/data/data1/current/BP-841800232-172.31.14.131-1675839779404] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:08,495 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/cluster_98ed82c7-d295-0ba7-07a2-91bfd72c9573/dfs/data/data2/current/BP-841800232-172.31.14.131-1675839779404] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:08,506 INFO [Listener at localhost/40875] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:08,626 INFO [Listener at localhost/40875] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 07:03:08,671 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 07:03:08,685 INFO [Listener at localhost/40875] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=155 (was 103) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:39907 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:39907 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:39907 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40875 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45251,1675839780181)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:39907 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:39907 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39907 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:39907 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=531 (was 537), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=306 (was 318), ProcessCount=165 (was 165), AvailableMemoryMB=4381 (was 4692) 2023-02-08 07:03:08,695 INFO [Listener at localhost/40875] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=155, OpenFileDescriptor=531, MaxFileDescriptor=60000, SystemLoadAverage=306, ProcessCount=165, AvailableMemoryMB=4380 2023-02-08 07:03:08,705 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/hadoop.log.dir so I do NOT create it in target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5 2023-02-08 07:03:08,705 WARN [Listener at localhost/40875] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/hadoop.log.dir Erasing configuration value by system value. 2023-02-08 07:03:08,705 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/hadoop.tmp.dir so I do NOT create it in target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5 2023-02-08 07:03:08,705 WARN [Listener at localhost/40875] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86fa8cfc-59a1-e8af-f9c6-58ff49f6ac48/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-08 07:03:08,705 DEBUG [Listener at localhost/40875] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5 2023-02-08 07:03:08,706 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 07:03:08,706 INFO [Listener at localhost/40875] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/cluster_0a41a84f-d676-858e-f2cf-1a9c9daf0107, deleteOnExit=true 2023-02-08 07:03:08,706 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 07:03:08,706 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/test.cache.data in system properties and HBase conf 2023-02-08 07:03:08,706 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 07:03:08,706 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/hadoop.log.dir in system properties and HBase conf 2023-02-08 07:03:08,706 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 07:03:08,707 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 07:03:08,707 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 07:03:08,707 DEBUG [Listener at localhost/40875] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 07:03:08,707 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:03:08,707 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:03:08,707 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 07:03:08,708 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:03:08,708 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 07:03:08,708 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 07:03:08,708 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:03:08,708 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:03:08,708 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 07:03:08,709 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/nfs.dump.dir in system properties and HBase conf 2023-02-08 07:03:08,709 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/java.io.tmpdir in system properties and HBase conf 2023-02-08 07:03:08,709 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:03:08,709 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 07:03:08,709 INFO [Listener at localhost/40875] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 07:03:08,714 WARN [Listener at localhost/40875] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:03:08,714 WARN [Listener at localhost/40875] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:03:08,755 WARN [Listener at localhost/40875] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:08,757 INFO [Listener at localhost/40875] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:08,762 INFO [Listener at localhost/40875] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/java.io.tmpdir/Jetty_localhost_34625_hdfs____7sslnm/webapp 2023-02-08 07:03:08,854 INFO [Listener at localhost/40875] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34625 2023-02-08 07:03:08,858 WARN [Listener at localhost/40875] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:03:08,859 WARN [Listener at localhost/40875] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:03:08,901 WARN [Listener at localhost/43261] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:08,914 WARN [Listener at localhost/43261] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:03:08,916 WARN [Listener at localhost/43261] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:08,917 INFO [Listener at localhost/43261] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:08,923 INFO [Listener at localhost/43261] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/java.io.tmpdir/Jetty_localhost_38439_datanode____p7tkl8/webapp 2023-02-08 07:03:09,014 INFO [Listener at localhost/43261] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38439 2023-02-08 07:03:09,021 WARN [Listener at localhost/37629] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:09,033 WARN [Listener at localhost/37629] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:03:09,035 WARN [Listener at localhost/37629] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:09,036 INFO [Listener at localhost/37629] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:09,039 INFO [Listener at localhost/37629] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/java.io.tmpdir/Jetty_localhost_46779_datanode____yt1dku/webapp 2023-02-08 07:03:09,121 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xde92b9ef04bf841: Processing first storage report for DS-b92c4556-b3db-4193-a07d-a3d6d2ddfd8f from datanode 100be329-8617-4929-8079-ffdbdf93118c 2023-02-08 07:03:09,121 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xde92b9ef04bf841: from storage DS-b92c4556-b3db-4193-a07d-a3d6d2ddfd8f node DatanodeRegistration(127.0.0.1:39727, datanodeUuid=100be329-8617-4929-8079-ffdbdf93118c, infoPort=38723, infoSecurePort=0, ipcPort=37629, storageInfo=lv=-57;cid=testClusterID;nsid=2013647444;c=1675839788717), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:09,121 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xde92b9ef04bf841: Processing first storage report for DS-8b3863f4-bfc5-40c8-afde-a01a6c287367 from datanode 100be329-8617-4929-8079-ffdbdf93118c 2023-02-08 07:03:09,121 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xde92b9ef04bf841: from storage DS-8b3863f4-bfc5-40c8-afde-a01a6c287367 node DatanodeRegistration(127.0.0.1:39727, datanodeUuid=100be329-8617-4929-8079-ffdbdf93118c, infoPort=38723, infoSecurePort=0, ipcPort=37629, storageInfo=lv=-57;cid=testClusterID;nsid=2013647444;c=1675839788717), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:09,137 INFO [Listener at localhost/37629] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46779 2023-02-08 07:03:09,144 WARN [Listener at localhost/43105] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:09,235 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1fc0cf2d9c5f848f: Processing first storage report for DS-a82bd3bc-8bc3-4e3e-85b8-f3755cb16151 from datanode 80ee05d1-10b6-4552-be05-ca03f7c8adec 2023-02-08 07:03:09,236 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1fc0cf2d9c5f848f: from storage DS-a82bd3bc-8bc3-4e3e-85b8-f3755cb16151 node DatanodeRegistration(127.0.0.1:39467, datanodeUuid=80ee05d1-10b6-4552-be05-ca03f7c8adec, infoPort=40129, infoSecurePort=0, ipcPort=43105, storageInfo=lv=-57;cid=testClusterID;nsid=2013647444;c=1675839788717), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-08 07:03:09,236 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1fc0cf2d9c5f848f: Processing first storage report for DS-4731d55a-3e67-4fbe-8f1d-91373181ed66 from datanode 80ee05d1-10b6-4552-be05-ca03f7c8adec 2023-02-08 07:03:09,236 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1fc0cf2d9c5f848f: from storage DS-4731d55a-3e67-4fbe-8f1d-91373181ed66 node DatanodeRegistration(127.0.0.1:39467, datanodeUuid=80ee05d1-10b6-4552-be05-ca03f7c8adec, infoPort=40129, infoSecurePort=0, ipcPort=43105, storageInfo=lv=-57;cid=testClusterID;nsid=2013647444;c=1675839788717), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:09,252 DEBUG [Listener at localhost/43105] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5 2023-02-08 07:03:09,254 INFO [Listener at localhost/43105] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/cluster_0a41a84f-d676-858e-f2cf-1a9c9daf0107/zookeeper_0, clientPort=54442, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/cluster_0a41a84f-d676-858e-f2cf-1a9c9daf0107/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/cluster_0a41a84f-d676-858e-f2cf-1a9c9daf0107/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 07:03:09,255 INFO [Listener at localhost/43105] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54442 2023-02-08 07:03:09,255 INFO [Listener at localhost/43105] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:09,256 INFO [Listener at localhost/43105] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:09,267 INFO [Listener at localhost/43105] util.FSUtils(479): Created version file at hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984 with version=8 2023-02-08 07:03:09,267 INFO [Listener at localhost/43105] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:09,268 INFO [Listener at localhost/43105] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:09,269 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43261/user/jenkins/test-data/d2934cbe-5c35-9c67-3201-dd8f08c573ad/hbase-staging 2023-02-08 07:03:09,271 INFO [Listener at localhost/43105] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:09,271 INFO [Listener at localhost/43105] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:09,271 INFO [Listener at localhost/43105] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:09,271 INFO [Listener at localhost/43105] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:09,271 INFO [Listener at localhost/43105] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:09,271 INFO [Listener at localhost/43105] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:09,272 INFO [Listener at localhost/43105] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:09,273 INFO [Listener at localhost/43105] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36283 2023-02-08 07:03:09,273 INFO [Listener at localhost/43105] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:09,274 INFO [Listener at localhost/43105] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:09,275 INFO [Listener at localhost/43105] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36283 connecting to ZooKeeper ensemble=127.0.0.1:54442 2023-02-08 07:03:09,281 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:362830x0, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:09,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36283-0x10032bdc28a0000 connected 2023-02-08 07:03:09,300 DEBUG [Listener at localhost/43105] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:09,301 DEBUG [Listener at localhost/43105] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:09,301 DEBUG [Listener at localhost/43105] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:09,304 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36283 2023-02-08 07:03:09,304 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36283 2023-02-08 07:03:09,305 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36283 2023-02-08 07:03:09,305 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36283 2023-02-08 07:03:09,305 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36283 2023-02-08 07:03:09,305 INFO [Listener at localhost/43105] master.HMaster(439): hbase.rootdir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984, hbase.cluster.distributed=false 2023-02-08 07:03:09,318 INFO [Listener at localhost/43105] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:09,318 INFO [Listener at localhost/43105] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:09,318 INFO [Listener at localhost/43105] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:09,318 INFO [Listener at localhost/43105] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:09,319 INFO [Listener at localhost/43105] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:09,319 INFO [Listener at localhost/43105] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:09,319 INFO [Listener at localhost/43105] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:09,321 INFO [Listener at localhost/43105] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40013 2023-02-08 07:03:09,321 INFO [Listener at localhost/43105] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:03:09,323 DEBUG [Listener at localhost/43105] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:09,324 INFO [Listener at localhost/43105] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:09,325 INFO [Listener at localhost/43105] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:09,326 INFO [Listener at localhost/43105] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40013 connecting to ZooKeeper ensemble=127.0.0.1:54442 2023-02-08 07:03:09,329 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:400130x0, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:09,330 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40013-0x10032bdc28a0001 connected 2023-02-08 07:03:09,330 DEBUG [Listener at localhost/43105] zookeeper.ZKUtil(164): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:09,331 DEBUG [Listener at localhost/43105] zookeeper.ZKUtil(164): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:09,331 DEBUG [Listener at localhost/43105] zookeeper.ZKUtil(164): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:09,332 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40013 2023-02-08 07:03:09,335 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40013 2023-02-08 07:03:09,335 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40013 2023-02-08 07:03:09,335 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40013 2023-02-08 07:03:09,335 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40013 2023-02-08 07:03:09,346 INFO [Listener at localhost/43105] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:09,346 INFO [Listener at localhost/43105] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:09,346 INFO [Listener at localhost/43105] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:09,346 INFO [Listener at localhost/43105] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:09,346 INFO [Listener at localhost/43105] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:09,346 INFO [Listener at localhost/43105] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:09,346 INFO [Listener at localhost/43105] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:09,350 INFO [Listener at localhost/43105] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36125 2023-02-08 07:03:09,351 INFO [Listener at localhost/43105] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:03:09,352 DEBUG [Listener at localhost/43105] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:09,352 INFO [Listener at localhost/43105] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:09,353 INFO [Listener at localhost/43105] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:09,354 INFO [Listener at localhost/43105] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36125 connecting to ZooKeeper ensemble=127.0.0.1:54442 2023-02-08 07:03:09,357 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:361250x0, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:09,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36125-0x10032bdc28a0002 connected 2023-02-08 07:03:09,361 DEBUG [Listener at localhost/43105] zookeeper.ZKUtil(164): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:09,361 DEBUG [Listener at localhost/43105] zookeeper.ZKUtil(164): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:09,362 DEBUG [Listener at localhost/43105] zookeeper.ZKUtil(164): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:09,364 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36125 2023-02-08 07:03:09,364 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36125 2023-02-08 07:03:09,364 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36125 2023-02-08 07:03:09,367 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36125 2023-02-08 07:03:09,367 DEBUG [Listener at localhost/43105] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36125 2023-02-08 07:03:09,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36283,1675839789271 2023-02-08 07:03:09,371 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:03:09,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36283,1675839789271 2023-02-08 07:03:09,379 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:09,379 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:09,379 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:09,379 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:09,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:03:09,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36283,1675839789271 from backup master directory 2023-02-08 07:03:09,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:03:09,382 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36283,1675839789271 2023-02-08 07:03:09,383 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:09,383 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:03:09,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,36283,1675839789271 2023-02-08 07:03:09,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/hbase.id with ID: 18aa4d18-d8cf-49a9-9407-fc3ee92373a8 2023-02-08 07:03:09,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:09,406 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:09,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1169fe3f to 127.0.0.1:54442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:09,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bacb10f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:09,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:09,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 07:03:09,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:09,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/data/master/store-tmp 2023-02-08 07:03:09,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:09,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:03:09,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:09,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:09,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:03:09,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:09,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:09,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839789434Disabling compacts and flushes for region at 1675839789434Disabling writes for close at 1675839789434Writing region close event to WAL at 1675839789434Closed at 1675839789434 2023-02-08 07:03:09,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/WALs/jenkins-hbase4.apache.org,36283,1675839789271 2023-02-08 07:03:09,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36283%2C1675839789271, suffix=, logDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/WALs/jenkins-hbase4.apache.org,36283,1675839789271, archiveDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/oldWALs, maxLogs=10 2023-02-08 07:03:09,451 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39727,DS-b92c4556-b3db-4193-a07d-a3d6d2ddfd8f,DISK] 2023-02-08 07:03:09,452 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39467,DS-a82bd3bc-8bc3-4e3e-85b8-f3755cb16151,DISK] 2023-02-08 07:03:09,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/WALs/jenkins-hbase4.apache.org,36283,1675839789271/jenkins-hbase4.apache.org%2C36283%2C1675839789271.1675839789437 2023-02-08 07:03:09,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39727,DS-b92c4556-b3db-4193-a07d-a3d6d2ddfd8f,DISK], DatanodeInfoWithStorage[127.0.0.1:39467,DS-a82bd3bc-8bc3-4e3e-85b8-f3755cb16151,DISK]] 2023-02-08 07:03:09,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:09,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:09,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:09,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:09,458 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:09,459 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 07:03:09,460 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 07:03:09,460 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:09,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:09,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:09,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:09,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:09,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71298148, jitterRate=0.062425196170806885}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:03:09,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675839789456Initializing all the Stores at 1675839789456Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839789457 (+1 ms)Cleaning up temporary data from old regions at 1675839789461 (+4 ms)Cleaning up detritus from prior splits at 1675839789462 (+1 ms)Region opened successfully at 1675839789469 (+7 ms) 2023-02-08 07:03:09,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 07:03:09,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 07:03:09,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 07:03:09,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 07:03:09,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-08 07:03:09,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-08 07:03:09,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 07:03:09,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 07:03:09,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 07:03:09,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 07:03:09,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 07:03:09,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 07:03:09,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 07:03:09,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 07:03:09,487 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:09,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 07:03:09,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 07:03:09,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 07:03:09,490 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:09,490 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:09,490 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:09,490 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:09,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,36283,1675839789271, sessionid=0x10032bdc28a0000, setting cluster-up flag (Was=false) 2023-02-08 07:03:09,494 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:09,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 07:03:09,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36283,1675839789271 2023-02-08 07:03:09,507 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:09,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 07:03:09,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36283,1675839789271 2023-02-08 07:03:09,512 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.hbase-snapshot/.tmp 2023-02-08 07:03:09,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:09,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:09,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:09,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:09,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:09,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 07:03:09,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:09,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675839819516 2023-02-08 07:03:09,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 07:03:09,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 07:03:09,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 07:03:09,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 07:03:09,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 07:03:09,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 07:03:09,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,518 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:09,518 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 07:03:09,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 07:03:09,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 07:03:09,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 07:03:09,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 07:03:09,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 07:03:09,520 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:09,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839789519,5,FailOnTimeoutGroup] 2023-02-08 07:03:09,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839789520,5,FailOnTimeoutGroup] 2023-02-08 07:03:09,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 07:03:09,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,530 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:09,530 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:09,531 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984 2023-02-08 07:03:09,542 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:09,544 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:03:09,545 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/info 2023-02-08 07:03:09,545 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:03:09,546 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:09,546 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:03:09,547 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:09,547 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:03:09,548 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:09,548 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:03:09,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/table 2023-02-08 07:03:09,549 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:03:09,550 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:09,550 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740 2023-02-08 07:03:09,550 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740 2023-02-08 07:03:09,552 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:03:09,553 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:03:09,554 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:09,554 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63636988, jitterRate=-0.051734983921051025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:03:09,555 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675839789542Initializing all the Stores at 1675839789542Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839789542Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839789544 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839789544Cleaning up temporary data from old regions at 1675839789551 (+7 ms)Cleaning up detritus from prior splits at 1675839789551Region opened successfully at 1675839789554 (+3 ms) 2023-02-08 07:03:09,555 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:03:09,555 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:03:09,555 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:03:09,555 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:03:09,555 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:03:09,555 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:09,555 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839789555Disabling compacts and flushes for region at 1675839789555Disabling writes for close at 1675839789555Writing region close event to WAL at 1675839789555Closed at 1675839789555 2023-02-08 07:03:09,556 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:09,556 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 07:03:09,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 07:03:09,557 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 07:03:09,559 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 07:03:09,569 INFO [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(952): ClusterId : 18aa4d18-d8cf-49a9-9407-fc3ee92373a8 2023-02-08 07:03:09,569 INFO [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(952): ClusterId : 18aa4d18-d8cf-49a9-9407-fc3ee92373a8 2023-02-08 07:03:09,569 DEBUG [RS:1;jenkins-hbase4:36125] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:03:09,569 DEBUG [RS:0;jenkins-hbase4:40013] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:03:09,575 DEBUG [RS:1;jenkins-hbase4:36125] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:03:09,575 DEBUG [RS:0;jenkins-hbase4:40013] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:03:09,575 DEBUG [RS:1;jenkins-hbase4:36125] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:03:09,575 DEBUG [RS:0;jenkins-hbase4:40013] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:03:09,578 DEBUG [RS:1;jenkins-hbase4:36125] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:03:09,579 DEBUG [RS:0;jenkins-hbase4:40013] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:03:09,579 DEBUG [RS:1;jenkins-hbase4:36125] zookeeper.ReadOnlyZKClient(139): Connect 0x0b9aa108 to 127.0.0.1:54442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:09,579 DEBUG [RS:0;jenkins-hbase4:40013] zookeeper.ReadOnlyZKClient(139): Connect 0x6d5fb508 to 127.0.0.1:54442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:09,590 DEBUG [RS:1;jenkins-hbase4:36125] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55d5e0b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:09,590 DEBUG [RS:0;jenkins-hbase4:40013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@639856d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:09,590 DEBUG [RS:1;jenkins-hbase4:36125] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@162ca78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:09,590 DEBUG [RS:0;jenkins-hbase4:40013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67a7de78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:09,603 DEBUG [RS:1;jenkins-hbase4:36125] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36125 2023-02-08 07:03:09,603 DEBUG [RS:0;jenkins-hbase4:40013] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40013 2023-02-08 07:03:09,603 INFO [RS:1;jenkins-hbase4:36125] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:03:09,604 INFO [RS:1;jenkins-hbase4:36125] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:03:09,604 INFO [RS:0;jenkins-hbase4:40013] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:03:09,604 INFO [RS:0;jenkins-hbase4:40013] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:03:09,604 DEBUG [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:03:09,604 DEBUG [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:03:09,604 INFO [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36283,1675839789271 with isa=jenkins-hbase4.apache.org/172.31.14.131:36125, startcode=1675839789346 2023-02-08 07:03:09,604 INFO [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36283,1675839789271 with isa=jenkins-hbase4.apache.org/172.31.14.131:40013, startcode=1675839789318 2023-02-08 07:03:09,604 DEBUG [RS:0;jenkins-hbase4:40013] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:03:09,604 DEBUG [RS:1;jenkins-hbase4:36125] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:03:09,607 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52313, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:03:09,607 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41117, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:03:09,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36283] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:09,609 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:09,609 DEBUG [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984 2023-02-08 07:03:09,609 DEBUG [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43261 2023-02-08 07:03:09,609 DEBUG [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:03:09,610 DEBUG [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984 2023-02-08 07:03:09,610 DEBUG [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43261 2023-02-08 07:03:09,610 DEBUG [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:03:09,611 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:09,614 DEBUG [RS:1;jenkins-hbase4:36125] zookeeper.ZKUtil(162): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:09,614 WARN [RS:1;jenkins-hbase4:36125] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:09,614 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40013,1675839789318] 2023-02-08 07:03:09,615 INFO [RS:1;jenkins-hbase4:36125] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:09,615 DEBUG [RS:0;jenkins-hbase4:40013] zookeeper.ZKUtil(162): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:09,615 DEBUG [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/WALs/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:09,615 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36125,1675839789346] 2023-02-08 07:03:09,615 WARN [RS:0;jenkins-hbase4:40013] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:09,615 INFO [RS:0;jenkins-hbase4:40013] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:09,615 DEBUG [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/WALs/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:09,620 DEBUG [RS:1;jenkins-hbase4:36125] zookeeper.ZKUtil(162): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:09,620 DEBUG [RS:0;jenkins-hbase4:40013] zookeeper.ZKUtil(162): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:09,620 DEBUG [RS:1;jenkins-hbase4:36125] zookeeper.ZKUtil(162): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:09,620 DEBUG [RS:0;jenkins-hbase4:40013] zookeeper.ZKUtil(162): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:09,621 DEBUG [RS:0;jenkins-hbase4:40013] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:03:09,621 DEBUG [RS:1;jenkins-hbase4:36125] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:03:09,621 INFO [RS:0;jenkins-hbase4:40013] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:03:09,621 INFO [RS:1;jenkins-hbase4:36125] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:03:09,622 INFO [RS:0;jenkins-hbase4:40013] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:03:09,622 INFO [RS:0;jenkins-hbase4:40013] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:03:09,623 INFO [RS:0;jenkins-hbase4:40013] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,624 INFO [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:03:09,626 INFO [RS:1;jenkins-hbase4:36125] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:03:09,627 INFO [RS:1;jenkins-hbase4:36125] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:03:09,627 INFO [RS:1;jenkins-hbase4:36125] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,627 INFO [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:03:09,627 INFO [RS:0;jenkins-hbase4:40013] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,628 DEBUG [RS:0;jenkins-hbase4:40013] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,628 DEBUG [RS:0;jenkins-hbase4:40013] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,628 DEBUG [RS:0;jenkins-hbase4:40013] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,628 DEBUG [RS:0;jenkins-hbase4:40013] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,628 DEBUG [RS:0;jenkins-hbase4:40013] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,628 INFO [RS:1;jenkins-hbase4:36125] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,628 DEBUG [RS:0;jenkins-hbase4:40013] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:09,629 DEBUG [RS:1;jenkins-hbase4:36125] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,629 DEBUG [RS:0;jenkins-hbase4:40013] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,629 DEBUG [RS:1;jenkins-hbase4:36125] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,629 DEBUG [RS:0;jenkins-hbase4:40013] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,629 DEBUG [RS:1;jenkins-hbase4:36125] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,629 DEBUG [RS:0;jenkins-hbase4:40013] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,629 DEBUG [RS:1;jenkins-hbase4:36125] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,629 DEBUG [RS:0;jenkins-hbase4:40013] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,629 DEBUG [RS:1;jenkins-hbase4:36125] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,629 DEBUG [RS:1;jenkins-hbase4:36125] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:09,629 DEBUG [RS:1;jenkins-hbase4:36125] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,629 DEBUG [RS:1;jenkins-hbase4:36125] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,629 DEBUG [RS:1;jenkins-hbase4:36125] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,629 DEBUG [RS:1;jenkins-hbase4:36125] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:09,633 INFO [RS:1;jenkins-hbase4:36125] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,633 INFO [RS:0;jenkins-hbase4:40013] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,633 INFO [RS:1;jenkins-hbase4:36125] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,633 INFO [RS:0;jenkins-hbase4:40013] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,633 INFO [RS:1;jenkins-hbase4:36125] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,633 INFO [RS:0;jenkins-hbase4:40013] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,644 INFO [RS:1;jenkins-hbase4:36125] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:03:09,644 INFO [RS:0;jenkins-hbase4:40013] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:03:09,644 INFO [RS:1;jenkins-hbase4:36125] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36125,1675839789346-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,644 INFO [RS:0;jenkins-hbase4:40013] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40013,1675839789318-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,660 INFO [RS:0;jenkins-hbase4:40013] regionserver.Replication(203): jenkins-hbase4.apache.org,40013,1675839789318 started 2023-02-08 07:03:09,660 INFO [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40013,1675839789318, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40013, sessionid=0x10032bdc28a0001 2023-02-08 07:03:09,660 INFO [RS:1;jenkins-hbase4:36125] regionserver.Replication(203): jenkins-hbase4.apache.org,36125,1675839789346 started 2023-02-08 07:03:09,660 DEBUG [RS:0;jenkins-hbase4:40013] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:03:09,660 DEBUG [RS:0;jenkins-hbase4:40013] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:09,660 INFO [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36125,1675839789346, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36125, sessionid=0x10032bdc28a0002 2023-02-08 07:03:09,660 DEBUG [RS:0;jenkins-hbase4:40013] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40013,1675839789318' 2023-02-08 07:03:09,660 DEBUG [RS:0;jenkins-hbase4:40013] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:09,660 DEBUG [RS:1;jenkins-hbase4:36125] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:03:09,660 DEBUG [RS:1;jenkins-hbase4:36125] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:09,660 DEBUG [RS:1;jenkins-hbase4:36125] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36125,1675839789346' 2023-02-08 07:03:09,660 DEBUG [RS:1;jenkins-hbase4:36125] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:09,661 DEBUG [RS:0;jenkins-hbase4:40013] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:09,661 DEBUG [RS:1;jenkins-hbase4:36125] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:09,661 DEBUG [RS:0;jenkins-hbase4:40013] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:03:09,661 DEBUG [RS:0;jenkins-hbase4:40013] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:03:09,661 DEBUG [RS:1;jenkins-hbase4:36125] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:03:09,661 DEBUG [RS:0;jenkins-hbase4:40013] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:09,661 DEBUG [RS:0;jenkins-hbase4:40013] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40013,1675839789318' 2023-02-08 07:03:09,661 DEBUG [RS:0;jenkins-hbase4:40013] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:09,661 DEBUG [RS:1;jenkins-hbase4:36125] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:03:09,661 DEBUG [RS:1;jenkins-hbase4:36125] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:09,661 DEBUG [RS:1;jenkins-hbase4:36125] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36125,1675839789346' 2023-02-08 07:03:09,661 DEBUG [RS:1;jenkins-hbase4:36125] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:09,661 DEBUG [RS:0;jenkins-hbase4:40013] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:09,662 DEBUG [RS:1;jenkins-hbase4:36125] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:09,662 DEBUG [RS:0;jenkins-hbase4:40013] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:03:09,662 INFO [RS:0;jenkins-hbase4:40013] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:03:09,662 INFO [RS:0;jenkins-hbase4:40013] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:03:09,662 DEBUG [RS:1;jenkins-hbase4:36125] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:03:09,662 INFO [RS:1;jenkins-hbase4:36125] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:03:09,662 INFO [RS:1;jenkins-hbase4:36125] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:03:09,709 DEBUG [jenkins-hbase4:36283] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 07:03:09,709 DEBUG [jenkins-hbase4:36283] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:09,711 DEBUG [jenkins-hbase4:36283] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:09,711 DEBUG [jenkins-hbase4:36283] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:09,711 DEBUG [jenkins-hbase4:36283] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:09,712 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36125,1675839789346, state=OPENING 2023-02-08 07:03:09,713 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 07:03:09,714 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:09,714 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:03:09,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36125,1675839789346}] 2023-02-08 07:03:09,868 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:09,869 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:03:09,870 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57520, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:03:09,874 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 07:03:09,874 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:09,876 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36125%2C1675839789346.meta, suffix=.meta, logDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/WALs/jenkins-hbase4.apache.org,36125,1675839789346, archiveDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/oldWALs, maxLogs=32 2023-02-08 07:03:09,891 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39727,DS-b92c4556-b3db-4193-a07d-a3d6d2ddfd8f,DISK] 2023-02-08 07:03:09,891 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39467,DS-a82bd3bc-8bc3-4e3e-85b8-f3755cb16151,DISK] 2023-02-08 07:03:09,892 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/WALs/jenkins-hbase4.apache.org,36125,1675839789346/jenkins-hbase4.apache.org%2C36125%2C1675839789346.meta.1675839789876.meta 2023-02-08 07:03:09,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39727,DS-b92c4556-b3db-4193-a07d-a3d6d2ddfd8f,DISK], DatanodeInfoWithStorage[127.0.0.1:39467,DS-a82bd3bc-8bc3-4e3e-85b8-f3755cb16151,DISK]] 2023-02-08 07:03:09,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:09,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 07:03:09,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 07:03:09,893 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 07:03:09,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 07:03:09,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:09,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 07:03:09,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 07:03:09,894 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:03:09,895 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/info 2023-02-08 07:03:09,895 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/info 2023-02-08 07:03:09,896 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:03:09,896 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:09,896 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:03:09,897 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:09,897 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:09,898 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:03:09,898 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:09,898 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:03:09,899 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/table 2023-02-08 07:03:09,899 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/table 2023-02-08 07:03:09,899 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:03:09,900 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:09,900 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740 2023-02-08 07:03:09,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740 2023-02-08 07:03:09,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:03:09,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:03:09,904 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60733970, jitterRate=-0.09499332308769226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:03:09,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675839789894Writing region info on filesystem at 1675839789894Initializing all the Stores at 1675839789894Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839789894Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839789894Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839789894Cleaning up temporary data from old regions at 1675839789902 (+8 ms)Cleaning up detritus from prior splits at 1675839789902Running coprocessor post-open hooks at 1675839789904 (+2 ms)Region opened successfully at 1675839789904 2023-02-08 07:03:09,905 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675839789868 2023-02-08 07:03:09,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 07:03:09,910 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 07:03:09,910 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36125,1675839789346, state=OPEN 2023-02-08 07:03:09,911 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 07:03:09,911 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:03:09,913 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 07:03:09,913 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36125,1675839789346 in 197 msec 2023-02-08 07:03:09,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 07:03:09,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 357 msec 2023-02-08 07:03:09,916 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 403 msec 2023-02-08 07:03:09,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675839789372, completionTime=-1 2023-02-08 07:03:09,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 07:03:09,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 07:03:09,920 DEBUG [hconnection-0x17725b37-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:09,921 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57528, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:09,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 07:03:09,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675839849923 2023-02-08 07:03:09,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675839909923 2023-02-08 07:03:09,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-08 07:03:09,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36283,1675839789271-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36283,1675839789271-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36283,1675839789271-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36283, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:09,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 07:03:09,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:09,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 07:03:09,934 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 07:03:09,934 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:03:09,935 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:03:09,936 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987 2023-02-08 07:03:09,937 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987 empty. 2023-02-08 07:03:09,937 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987 2023-02-08 07:03:09,937 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 07:03:09,951 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:09,952 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ae371f4abe31e929b9fec6e1fbaaf987, NAME => 'hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp 2023-02-08 07:03:09,961 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:09,961 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ae371f4abe31e929b9fec6e1fbaaf987, disabling compactions & flushes 2023-02-08 07:03:09,961 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. 2023-02-08 07:03:09,961 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. 2023-02-08 07:03:09,961 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. after waiting 0 ms 2023-02-08 07:03:09,961 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. 2023-02-08 07:03:09,961 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. 2023-02-08 07:03:09,961 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ae371f4abe31e929b9fec6e1fbaaf987: Waiting for close lock at 1675839789961Disabling compacts and flushes for region at 1675839789961Disabling writes for close at 1675839789961Writing region close event to WAL at 1675839789961Closed at 1675839789961 2023-02-08 07:03:09,963 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:03:09,964 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839789963"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839789963"}]},"ts":"1675839789963"} 2023-02-08 07:03:09,965 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 07:03:09,966 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:03:09,966 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839789966"}]},"ts":"1675839789966"} 2023-02-08 07:03:09,967 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 07:03:09,970 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:09,971 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:09,971 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:09,971 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:09,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ae371f4abe31e929b9fec6e1fbaaf987, ASSIGN}] 2023-02-08 07:03:09,974 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ae371f4abe31e929b9fec6e1fbaaf987, ASSIGN 2023-02-08 07:03:09,974 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ae371f4abe31e929b9fec6e1fbaaf987, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40013,1675839789318; forceNewPlan=false, retain=false 2023-02-08 07:03:10,124 INFO [jenkins-hbase4:36283] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 07:03:10,126 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ae371f4abe31e929b9fec6e1fbaaf987, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:10,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839790126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839790126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839790126"}]},"ts":"1675839790126"} 2023-02-08 07:03:10,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ae371f4abe31e929b9fec6e1fbaaf987, server=jenkins-hbase4.apache.org,40013,1675839789318}] 2023-02-08 07:03:10,280 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:10,280 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:03:10,282 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:03:10,286 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. 2023-02-08 07:03:10,288 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40013%2C1675839789318, suffix=, logDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/WALs/jenkins-hbase4.apache.org,40013,1675839789318, archiveDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/oldWALs, maxLogs=32 2023-02-08 07:03:10,304 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39467,DS-a82bd3bc-8bc3-4e3e-85b8-f3755cb16151,DISK] 2023-02-08 07:03:10,304 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39727,DS-b92c4556-b3db-4193-a07d-a3d6d2ddfd8f,DISK] 2023-02-08 07:03:10,308 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/WALs/jenkins-hbase4.apache.org,40013,1675839789318/jenkins-hbase4.apache.org%2C40013%2C1675839789318.1675839790288 2023-02-08 07:03:10,308 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39727,DS-b92c4556-b3db-4193-a07d-a3d6d2ddfd8f,DISK], DatanodeInfoWithStorage[127.0.0.1:39467,DS-a82bd3bc-8bc3-4e3e-85b8-f3755cb16151,DISK]] 2023-02-08 07:03:10,308 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ae371f4abe31e929b9fec6e1fbaaf987, NAME => 'hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:10,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ae371f4abe31e929b9fec6e1fbaaf987 2023-02-08 07:03:10,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:10,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ae371f4abe31e929b9fec6e1fbaaf987 2023-02-08 07:03:10,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ae371f4abe31e929b9fec6e1fbaaf987 2023-02-08 07:03:10,310 INFO [StoreOpener-ae371f4abe31e929b9fec6e1fbaaf987-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ae371f4abe31e929b9fec6e1fbaaf987 2023-02-08 07:03:10,311 DEBUG [StoreOpener-ae371f4abe31e929b9fec6e1fbaaf987-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987/info 2023-02-08 07:03:10,311 DEBUG [StoreOpener-ae371f4abe31e929b9fec6e1fbaaf987-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987/info 2023-02-08 07:03:10,312 INFO [StoreOpener-ae371f4abe31e929b9fec6e1fbaaf987-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae371f4abe31e929b9fec6e1fbaaf987 columnFamilyName info 2023-02-08 07:03:10,312 INFO [StoreOpener-ae371f4abe31e929b9fec6e1fbaaf987-1] regionserver.HStore(310): Store=ae371f4abe31e929b9fec6e1fbaaf987/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:10,313 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987 2023-02-08 07:03:10,313 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987 2023-02-08 07:03:10,332 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ae371f4abe31e929b9fec6e1fbaaf987 2023-02-08 07:03:10,334 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:10,335 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ae371f4abe31e929b9fec6e1fbaaf987; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61525391, jitterRate=-0.08320023119449615}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:03:10,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ae371f4abe31e929b9fec6e1fbaaf987: Running coprocessor pre-open hook at 1675839790309Writing region info on filesystem at 1675839790309Initializing all the Stores at 1675839790310 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839790310Cleaning up temporary data from old regions at 1675839790314 (+4 ms)Cleaning up detritus from prior splits at 1675839790314Running coprocessor post-open hooks at 1675839790335 (+21 ms)Region opened successfully at 1675839790335 2023-02-08 07:03:10,336 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987., pid=6, masterSystemTime=1675839790280 2023-02-08 07:03:10,339 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. 2023-02-08 07:03:10,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. 2023-02-08 07:03:10,340 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ae371f4abe31e929b9fec6e1fbaaf987, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:10,340 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839790340"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839790340"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839790340"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839790340"}]},"ts":"1675839790340"} 2023-02-08 07:03:10,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 07:03:10,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ae371f4abe31e929b9fec6e1fbaaf987, server=jenkins-hbase4.apache.org,40013,1675839789318 in 214 msec 2023-02-08 07:03:10,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 07:03:10,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ae371f4abe31e929b9fec6e1fbaaf987, ASSIGN in 372 msec 2023-02-08 07:03:10,348 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:03:10,348 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839790348"}]},"ts":"1675839790348"} 2023-02-08 07:03:10,349 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 07:03:10,353 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:03:10,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 421 msec 2023-02-08 07:03:10,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 07:03:10,435 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:10,435 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:10,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:10,440 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50820, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:10,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 07:03:10,449 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:10,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-08 07:03:10,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 07:03:10,471 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:10,473 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-08 07:03:10,487 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 07:03:10,490 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 07:03:10,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.107sec 2023-02-08 07:03:10,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 07:03:10,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 07:03:10,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 07:03:10,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36283,1675839789271-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 07:03:10,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36283,1675839789271-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 07:03:10,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 07:03:10,570 DEBUG [Listener at localhost/43105] zookeeper.ReadOnlyZKClient(139): Connect 0x149b3c48 to 127.0.0.1:54442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:10,575 DEBUG [Listener at localhost/43105] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b845c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:10,577 DEBUG [hconnection-0x2f7e60a9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:10,579 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57536, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:10,580 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36283,1675839789271 2023-02-08 07:03:10,581 DEBUG [Listener at localhost/43105] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 07:03:10,581 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:10,581 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:10,583 DEBUG [Listener at localhost/43105] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 07:03:10,585 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 07:03:10,586 INFO [Listener at localhost/43105] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:10,586 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 07:03:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 97 connection: 172.31.14.131:46410 deadline: 1675839850586, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:10,587 INFO [Listener at localhost/43105] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-08 07:03:10,588 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:10,588 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:10,591 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:10,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:10,594 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:03:10,594 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-08 07:03:10,594 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:10,594 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:10,594 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:03:10,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:10,596 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:10,597 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f empty. 2023-02-08 07:03:10,597 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:10,597 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-08 07:03:10,606 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:10,607 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => bc9e63779e26ebe83703a775d914134f, NAME => 'testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp 2023-02-08 07:03:10,614 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:10,615 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing bc9e63779e26ebe83703a775d914134f, disabling compactions & flushes 2023-02-08 07:03:10,615 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:10,615 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:10,615 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. after waiting 0 ms 2023-02-08 07:03:10,615 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:10,615 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:10,615 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for bc9e63779e26ebe83703a775d914134f: Waiting for close lock at 1675839790615Disabling compacts and flushes for region at 1675839790615Disabling writes for close at 1675839790615Writing region close event to WAL at 1675839790615Closed at 1675839790615 2023-02-08 07:03:10,617 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:03:10,618 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675839790618"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839790618"}]},"ts":"1675839790618"} 2023-02-08 07:03:10,619 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 07:03:10,620 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:03:10,620 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839790620"}]},"ts":"1675839790620"} 2023-02-08 07:03:10,622 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-08 07:03:10,626 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:10,627 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:10,627 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:10,627 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:10,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bc9e63779e26ebe83703a775d914134f, ASSIGN}] 2023-02-08 07:03:10,629 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bc9e63779e26ebe83703a775d914134f, ASSIGN 2023-02-08 07:03:10,630 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bc9e63779e26ebe83703a775d914134f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40013,1675839789318; forceNewPlan=false, retain=false 2023-02-08 07:03:10,664 INFO [RS:1;jenkins-hbase4:36125] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36125%2C1675839789346, suffix=, logDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/WALs/jenkins-hbase4.apache.org,36125,1675839789346, archiveDir=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/oldWALs, maxLogs=32 2023-02-08 07:03:10,678 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39727,DS-b92c4556-b3db-4193-a07d-a3d6d2ddfd8f,DISK] 2023-02-08 07:03:10,678 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39467,DS-a82bd3bc-8bc3-4e3e-85b8-f3755cb16151,DISK] 2023-02-08 07:03:10,681 INFO [RS:1;jenkins-hbase4:36125] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/WALs/jenkins-hbase4.apache.org,36125,1675839789346/jenkins-hbase4.apache.org%2C36125%2C1675839789346.1675839790664 2023-02-08 07:03:10,681 DEBUG [RS:1;jenkins-hbase4:36125] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39727,DS-b92c4556-b3db-4193-a07d-a3d6d2ddfd8f,DISK], DatanodeInfoWithStorage[127.0.0.1:39467,DS-a82bd3bc-8bc3-4e3e-85b8-f3755cb16151,DISK]] 2023-02-08 07:03:10,696 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:10,696 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:10,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:10,780 INFO [jenkins-hbase4:36283] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 07:03:10,781 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bc9e63779e26ebe83703a775d914134f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:10,781 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675839790781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839790781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839790781"}]},"ts":"1675839790781"} 2023-02-08 07:03:10,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure bc9e63779e26ebe83703a775d914134f, server=jenkins-hbase4.apache.org,40013,1675839789318}] 2023-02-08 07:03:10,897 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:10,898 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:10,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:10,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:10,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bc9e63779e26ebe83703a775d914134f, NAME => 'testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:10,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:10,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:10,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:10,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:10,940 INFO [StoreOpener-bc9e63779e26ebe83703a775d914134f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:10,941 DEBUG [StoreOpener-bc9e63779e26ebe83703a775d914134f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1 2023-02-08 07:03:10,941 DEBUG [StoreOpener-bc9e63779e26ebe83703a775d914134f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1 2023-02-08 07:03:10,942 INFO [StoreOpener-bc9e63779e26ebe83703a775d914134f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc9e63779e26ebe83703a775d914134f columnFamilyName f1 2023-02-08 07:03:10,942 INFO [StoreOpener-bc9e63779e26ebe83703a775d914134f-1] regionserver.HStore(310): Store=bc9e63779e26ebe83703a775d914134f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:10,942 INFO [StoreOpener-bc9e63779e26ebe83703a775d914134f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:10,943 DEBUG [StoreOpener-bc9e63779e26ebe83703a775d914134f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2 2023-02-08 07:03:10,944 DEBUG [StoreOpener-bc9e63779e26ebe83703a775d914134f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2 2023-02-08 07:03:10,944 INFO [StoreOpener-bc9e63779e26ebe83703a775d914134f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc9e63779e26ebe83703a775d914134f columnFamilyName f2 2023-02-08 07:03:10,944 INFO [StoreOpener-bc9e63779e26ebe83703a775d914134f-1] regionserver.HStore(310): Store=bc9e63779e26ebe83703a775d914134f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:10,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:10,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:10,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:10,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:10,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:10,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bc9e63779e26ebe83703a775d914134f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67338624, jitterRate=0.0034236907958984375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:10,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bc9e63779e26ebe83703a775d914134f: Running coprocessor pre-open hook at 1675839790939Writing region info on filesystem at 1675839790939Initializing all the Stores at 1675839790939Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839790940 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839790940Cleaning up temporary data from old regions at 1675839790946 (+6 ms)Cleaning up detritus from prior splits at 1675839790946Running coprocessor post-open hooks at 1675839790951 (+5 ms)Region opened successfully at 1675839790951 2023-02-08 07:03:10,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f., pid=12, masterSystemTime=1675839790935 2023-02-08 07:03:10,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:10,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:10,954 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bc9e63779e26ebe83703a775d914134f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:10,954 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675839790954"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839790954"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839790954"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839790954"}]},"ts":"1675839790954"} 2023-02-08 07:03:10,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-08 07:03:10,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure bc9e63779e26ebe83703a775d914134f, server=jenkins-hbase4.apache.org,40013,1675839789318 in 173 msec 2023-02-08 07:03:10,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-08 07:03:10,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bc9e63779e26ebe83703a775d914134f, ASSIGN in 330 msec 2023-02-08 07:03:10,959 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:03:10,960 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839790960"}]},"ts":"1675839790960"} 2023-02-08 07:03:10,961 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-08 07:03:10,963 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:03:10,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 372 msec 2023-02-08 07:03:11,199 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:11,199 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:11,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:11,201 INFO [Listener at localhost/43105] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-08 07:03:11,201 DEBUG [Listener at localhost/43105] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-08 07:03:11,201 INFO [Listener at localhost/43105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:03:11,203 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-08 07:03:11,203 INFO [Listener at localhost/43105] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:03:11,203 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-08 07:03:11,203 INFO [Listener at localhost/43105] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 07:03:11,221 DEBUG [hconnection-0x2f7e60a9-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:11,234 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50824, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:11,241 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40013] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:11,337 INFO [Listener at localhost/43105] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 07:03:11,337 INFO [Listener at localhost/43105] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 07:03:11,337 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:11,337 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:11,339 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-08 07:03:11,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675839791339 (current time:1675839791339). 2023-02-08 07:03:11,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 07:03:11,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] zookeeper.ReadOnlyZKClient(139): Connect 0x0b7b6053 to 127.0.0.1:54442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:11,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39bf5006, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:11,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:11,346 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57540, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:11,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b7b6053 to 127.0.0.1:54442 2023-02-08 07:03:11,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:11,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 07:03:11,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-08 07:03:11,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-08 07:03:11,351 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-08 07:03:11,352 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1675840391352 2023-02-08 07:03:11,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-08 07:03:11,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,354 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-08 07:03:11,354 DEBUG [Listener at localhost/43105] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 07:03:11,354 DEBUG [Listener at localhost/43105] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 07:03:11,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-08 07:03:11,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-08 07:03:11,355 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-08 07:03:11,355 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1675840391355 2023-02-08 07:03:11,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-08 07:03:11,367 INFO [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-08 07:03:11,367 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:11,368 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-08 07:03:11,368 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-08 07:03:11,368 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,368 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-08 07:03:11,371 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,372 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:11,372 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:11,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:11,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:11,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:11,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:11,372 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,372 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:03:11,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-08 07:03:11,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-08 07:03:11,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-08 07:03:11,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-08 07:03:11,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-08 07:03:11,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-08 07:03:11,373 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-08 07:03:11,373 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-08 07:03:11,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-08 07:03:11,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-08 07:03:11,376 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-08 07:03:11,376 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:11,376 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-08 07:03:11,377 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-08 07:03:11,377 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-08 07:03:11,377 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:11,377 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36125,1675839789346' joining acquired barrier for procedure (foo) in zk 2023-02-08 07:03:11,377 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-08 07:03:11,377 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-08 07:03:11,377 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40013,1675839789318' joining acquired barrier for procedure (foo) in zk 2023-02-08 07:03:11,379 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,379 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,379 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:11,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:11,379 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,379 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:11,379 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,379 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:11,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:11,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:11,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 07:03:11,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:11,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40013,1675839789318' joining acquired barrier for procedure 'foo' on coordinator 2023-02-08 07:03:11,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52d9238b[Count = 0] remaining members to acquire global barrier 2023-02-08 07:03:11,381 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-08 07:03:11,381 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,382 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,382 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,382 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-08 07:03:11,383 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,383 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:03:11,383 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-08 07:03:11,383 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-08 07:03:11,383 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,36125,1675839789346' in zk 2023-02-08 07:03:11,384 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-08 07:03:11,384 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 07:03:11,384 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:11,384 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. started... 2023-02-08 07:03:11,385 INFO [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bc9e63779e26ebe83703a775d914134f 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-08 07:03:11,385 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-08 07:03:11,385 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:11,385 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-08 07:03:11,406 INFO [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/.tmp/f1/37d837bb13c241459db56afe52e9c684 2023-02-08 07:03:11,424 INFO [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/.tmp/f2/c4d3937f5a8c42bab40fbfa5c80d98d9 2023-02-08 07:03:11,429 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/.tmp/f1/37d837bb13c241459db56afe52e9c684 as hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1/37d837bb13c241459db56afe52e9c684 2023-02-08 07:03:11,433 INFO [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1/37d837bb13c241459db56afe52e9c684, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 07:03:11,434 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/.tmp/f2/c4d3937f5a8c42bab40fbfa5c80d98d9 as hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2/c4d3937f5a8c42bab40fbfa5c80d98d9 2023-02-08 07:03:11,438 INFO [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2/c4d3937f5a8c42bab40fbfa5c80d98d9, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 07:03:11,438 INFO [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for bc9e63779e26ebe83703a775d914134f in 54ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:11,439 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-08 07:03:11,439 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bc9e63779e26ebe83703a775d914134f: 2023-02-08 07:03:11,439 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.' region-info for snapshot=foo 2023-02-08 07:03:11,439 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:11,439 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1/37d837bb13c241459db56afe52e9c684] hfiles 2023-02-08 07:03:11,439 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1/37d837bb13c241459db56afe52e9c684 for snapshot=foo 2023-02-08 07:03:11,439 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2/c4d3937f5a8c42bab40fbfa5c80d98d9] hfiles 2023-02-08 07:03:11,439 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2/c4d3937f5a8c42bab40fbfa5c80d98d9 for snapshot=foo 2023-02-08 07:03:11,445 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. completed. 2023-02-08 07:03:11,445 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:11,445 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-08 07:03:11,445 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-08 07:03:11,445 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,445 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-08 07:03:11,445 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,40013,1675839789318' in zk 2023-02-08 07:03:11,448 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,448 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-08 07:03:11,448 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:11,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:11,448 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-08 07:03:11,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 07:03:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 07:03:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,40013,1675839789318': 2023-02-08 07:03:11,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40013,1675839789318' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-08 07:03:11,453 INFO [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-08 07:03:11,453 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:03:11,453 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:03:11,453 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-08 07:03:11,453 INFO [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 07:03:11,454 DEBUG [Listener at localhost/43105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:11,454 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:11,454 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:11,455 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,455 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,455 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,455 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:11,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,455 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:11,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-08 07:03:11,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:03:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:11,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:11,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:11,456 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 07:03:11,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:11,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:11,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,456 DEBUG [Listener at localhost/43105] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 07:03:11,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:11,456 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 07:03:11,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:11,458 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 07:03:11,458 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,463 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,463 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:11,463 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:11,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:11,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:11,463 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-08 07:03:11,463 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-08 07:03:11,463 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:11,463 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:11,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-08 07:03:11,463 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:11,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:11,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:11,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:11,463 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:11,464 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-08 07:03:11,465 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,465 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,465 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,465 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 07:03:11,465 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 07:03:11,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:11,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:11,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.hbase-snapshot/.tmp/foo 2023-02-08 07:03:11,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.hbase-snapshot/.tmp/foo to hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.hbase-snapshot/foo 2023-02-08 07:03:11,496 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-08 07:03:11,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.hbase-snapshot/.tmp/foo 2023-02-08 07:03:11,497 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.hbase-snapshot/.tmp/foo 2023-02-08 07:03:11,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1675839791352Consolidate snapshot: foo at 1675839791463 (+111 ms)Loading Region manifests for foo at 1675839791464 (+1 ms)Writing data manifest for foo at 1675839791468 (+4 ms)Verifying snapshot: foo at 1675839791475 (+7 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1675839791496 (+21 ms) 2023-02-08 07:03:11,498 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-08 07:03:11,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 145 msec 2023-02-08 07:03:11,656 DEBUG [Listener at localhost/43105] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:11,656 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:11,656 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:11,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-08 07:03:11,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 07:03:11,658 INFO [Listener at localhost/43105] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 07:03:11,658 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:11,658 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:11,662 INFO [Listener at localhost/43105] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 07:03:11,668 INFO [Listener at localhost/43105] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 07:03:11,751 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40013] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:11,851 INFO [Listener at localhost/43105] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 07:03:11,856 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:11,856 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:11,858 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 07:03:11,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,860 INFO [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-08 07:03:11,860 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:11,861 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-08 07:03:11,861 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-08 07:03:11,862 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,862 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,864 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,864 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:11,864 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:11,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:11,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:11,864 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,864 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:03:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:03:11,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:03:11,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-08 07:03:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-08 07:03:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:11,875 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-08 07:03:11,875 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-08 07:03:11,876 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-08 07:03:11,876 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36125,1675839789346' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-08 07:03:11,876 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 07:03:11,876 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 07:03:11,876 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:11,876 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. started... 2023-02-08 07:03:11,876 INFO [rs(jenkins-hbase4.apache.org,40013,1675839789318)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bc9e63779e26ebe83703a775d914134f 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-08 07:03:11,878 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,878 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,878 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:11,898 INFO [rs(jenkins-hbase4.apache.org,40013,1675839789318)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/.tmp/f1/7f6bd62630ad4c3695fc0d2f2bbbda30 2023-02-08 07:03:11,916 INFO [rs(jenkins-hbase4.apache.org,40013,1675839789318)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/.tmp/f2/4abf4328dd8b4decbe4bea8abc385e95 2023-02-08 07:03:11,921 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/.tmp/f1/7f6bd62630ad4c3695fc0d2f2bbbda30 as hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1/7f6bd62630ad4c3695fc0d2f2bbbda30 2023-02-08 07:03:11,925 INFO [rs(jenkins-hbase4.apache.org,40013,1675839789318)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1/7f6bd62630ad4c3695fc0d2f2bbbda30, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 07:03:11,926 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/.tmp/f2/4abf4328dd8b4decbe4bea8abc385e95 as hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2/4abf4328dd8b4decbe4bea8abc385e95 2023-02-08 07:03:11,930 INFO [rs(jenkins-hbase4.apache.org,40013,1675839789318)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2/4abf4328dd8b4decbe4bea8abc385e95, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 07:03:11,931 INFO [rs(jenkins-hbase4.apache.org,40013,1675839789318)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for bc9e63779e26ebe83703a775d914134f in 55ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:11,932 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bc9e63779e26ebe83703a775d914134f: 2023-02-08 07:03:11,932 DEBUG [rs(jenkins-hbase4.apache.org,40013,1675839789318)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:11,932 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 07:03:11,932 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 07:03:11,932 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,932 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-08 07:03:11,932 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40013,1675839789318' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-08 07:03:11,933 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,933 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:11,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:11,934 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,934 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:11,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:11,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:11,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:11,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40013,1675839789318' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-08 07:03:11,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e6ad08[Count = 0] remaining members to acquire global barrier 2023-02-08 07:03:11,936 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-08 07:03:11,936 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,937 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,937 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,937 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-08 07:03:11,937 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-08 07:03:11,937 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-08 07:03:11,937 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,937 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:03:11,937 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,36125,1675839789346' in zk 2023-02-08 07:03:11,937 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-08 07:03:11,937 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,40013,1675839789318' in zk 2023-02-08 07:03:11,940 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-08 07:03:11,940 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:11,940 DEBUG [member: 'jenkins-hbase4.apache.org,36125,1675839789346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-08 07:03:11,941 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,941 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-08 07:03:11,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:11,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:11,941 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:11,941 DEBUG [member: 'jenkins-hbase4.apache.org,40013,1675839789318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-08 07:03:11,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:11,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:11,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,40013,1675839789318': 2023-02-08 07:03:11,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40013,1675839789318' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-08 07:03:11,945 INFO [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-08 07:03:11,945 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:03:11,945 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:03:11,945 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,945 INFO [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 07:03:11,946 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,946 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:11,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,947 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:11,947 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,947 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:11,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:11,947 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:11,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,947 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,949 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:11,949 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,952 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:11,952 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:11,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:11,952 DEBUG [(jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:11,952 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:11,952 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-08 07:03:11,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:11,952 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,952 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:11,953 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:11,953 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 07:03:11,953 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:11,953 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:11,953 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:11,953 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,953 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:11,953 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,953 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:11,953 DEBUG [Listener at localhost/43105] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-08 07:03:11,954 DEBUG [Listener at localhost/43105] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 07:03:12,054 DEBUG [Listener at localhost/43105] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 07:03:12,054 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:12,054 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:12,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 07:03:12,060 INFO [Listener at localhost/43105] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675839791339 type: FLUSH version: 2 ttl: 0 2023-02-08 07:03:12,060 DEBUG [Listener at localhost/43105] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43261/user/jenkins/test-data/d2934cbe-5c35-9c67-3201-dd8f08c573ad/foo/d4bc3da6-b481-4318-b116-383618f13fcd/data/default/testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,060 INFO [Listener at localhost/43105] snapshot.RestoreSnapshotHelper(239): region to add: bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:12,060 INFO [Listener at localhost/43105] snapshot.RestoreSnapshotHelper(585): clone region=bc9e63779e26ebe83703a775d914134f as bc9e63779e26ebe83703a775d914134f in snapshot foo 2023-02-08 07:03:12,061 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => bc9e63779e26ebe83703a775d914134f, NAME => 'testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43261/user/jenkins/test-data/d2934cbe-5c35-9c67-3201-dd8f08c573ad/foo/d4bc3da6-b481-4318-b116-383618f13fcd 2023-02-08 07:03:12,076 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:12,076 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 37d837bb13c241459db56afe52e9c684 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,078 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c4d3937f5a8c42bab40fbfa5c80d98d9 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,081 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing bc9e63779e26ebe83703a775d914134f, disabling compactions & flushes 2023-02-08 07:03:12,081 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:12,081 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:12,081 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. after waiting 0 ms 2023-02-08 07:03:12,081 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:12,081 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:12,081 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for bc9e63779e26ebe83703a775d914134f: Waiting for close lock at 1675839792081Disabling compacts and flushes for region at 1675839792081Disabling writes for close at 1675839792081Writing region close event to WAL at 1675839792081Closed at 1675839792081 2023-02-08 07:03:12,081 INFO [Listener at localhost/43105] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675839791339 type: FLUSH version: 2 ttl: 0 2023-02-08 07:03:12,081 DEBUG [Listener at localhost/43105] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43261/user/jenkins/test-data/d2934cbe-5c35-9c67-3201-dd8f08c573ad/foo/d4bc3da6-b481-4318-b116-383618f13fcd 2023-02-08 07:03:12,082 DEBUG [Listener at localhost/43105] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43261/user/jenkins/test-data/d2934cbe-5c35-9c67-3201-dd8f08c573ad/foo/d4bc3da6-b481-4318-b116-383618f13fcd 2023-02-08 07:03:12,082 DEBUG [Listener at localhost/43105] util.CommonFSUtils(699): |-data/ 2023-02-08 07:03:12,083 DEBUG [Listener at localhost/43105] util.CommonFSUtils(699): |----default/ 2023-02-08 07:03:12,083 DEBUG [Listener at localhost/43105] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-08 07:03:12,084 DEBUG [Listener at localhost/43105] util.CommonFSUtils(699): |----------bc9e63779e26ebe83703a775d914134f/ 2023-02-08 07:03:12,084 DEBUG [Listener at localhost/43105] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:12,084 DEBUG [Listener at localhost/43105] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:12,085 DEBUG [Listener at localhost/43105] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=bc9e63779e26ebe83703a775d914134f-37d837bb13c241459db56afe52e9c684 2023-02-08 07:03:12,085 DEBUG [Listener at localhost/43105] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:12,085 DEBUG [Listener at localhost/43105] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=bc9e63779e26ebe83703a775d914134f-c4d3937f5a8c42bab40fbfa5c80d98d9 2023-02-08 07:03:12,086 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:12,086 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:12,087 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-08 07:03:12,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-08 07:03:12,090 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:12,090 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:12,090 INFO [Listener at localhost/43105] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,091 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,093 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:12,093 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:12,094 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839792094"}]},"ts":"1675839792094"} 2023-02-08 07:03:12,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 07:03:12,096 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-08 07:03:12,098 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-08 07:03:12,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bc9e63779e26ebe83703a775d914134f, UNASSIGN}] 2023-02-08 07:03:12,100 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bc9e63779e26ebe83703a775d914134f, UNASSIGN 2023-02-08 07:03:12,100 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bc9e63779e26ebe83703a775d914134f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:12,101 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675839792100"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839792100"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839792100"}]},"ts":"1675839792100"} 2023-02-08 07:03:12,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure bc9e63779e26ebe83703a775d914134f, server=jenkins-hbase4.apache.org,40013,1675839789318}] 2023-02-08 07:03:12,195 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:12,195 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:12,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 07:03:12,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:12,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bc9e63779e26ebe83703a775d914134f, disabling compactions & flushes 2023-02-08 07:03:12,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:12,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:12,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. after waiting 0 ms 2023-02-08 07:03:12,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:12,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:12,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f. 2023-02-08 07:03:12,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bc9e63779e26ebe83703a775d914134f: Waiting for close lock at 1675839792254Running coprocessor pre-close hooks at 1675839792254Disabling compacts and flushes for region at 1675839792254Disabling writes for close at 1675839792254Writing region close event to WAL at 1675839792255 (+1 ms)Running coprocessor post-close hooks at 1675839792258 (+3 ms)Closed at 1675839792258 2023-02-08 07:03:12,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:12,260 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bc9e63779e26ebe83703a775d914134f, regionState=CLOSED 2023-02-08 07:03:12,260 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675839792260"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839792260"}]},"ts":"1675839792260"} 2023-02-08 07:03:12,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-08 07:03:12,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure bc9e63779e26ebe83703a775d914134f, server=jenkins-hbase4.apache.org,40013,1675839789318 in 159 msec 2023-02-08 07:03:12,264 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-08 07:03:12,264 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bc9e63779e26ebe83703a775d914134f, UNASSIGN in 164 msec 2023-02-08 07:03:12,265 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839792265"}]},"ts":"1675839792265"} 2023-02-08 07:03:12,266 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-08 07:03:12,268 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-08 07:03:12,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 177 msec 2023-02-08 07:03:12,396 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:12,397 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:12,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 07:03:12,398 INFO [Listener at localhost/43105] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-08 07:03:12,399 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:12,399 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:12,399 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,402 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,402 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:12,402 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:12,403 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 07:03:12,406 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:12,408 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1, FileablePath, hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2, FileablePath, hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/recovered.edits] 2023-02-08 07:03:12,411 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1/37d837bb13c241459db56afe52e9c684 to hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/archive/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1/37d837bb13c241459db56afe52e9c684 2023-02-08 07:03:12,412 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1/7f6bd62630ad4c3695fc0d2f2bbbda30 to hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/archive/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f1/7f6bd62630ad4c3695fc0d2f2bbbda30 2023-02-08 07:03:12,415 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2/4abf4328dd8b4decbe4bea8abc385e95 to hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/archive/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2/4abf4328dd8b4decbe4bea8abc385e95 2023-02-08 07:03:12,416 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2/c4d3937f5a8c42bab40fbfa5c80d98d9 to hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/archive/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/f2/c4d3937f5a8c42bab40fbfa5c80d98d9 2023-02-08 07:03:12,418 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/recovered.edits/12.seqid to hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/archive/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f/recovered.edits/12.seqid 2023-02-08 07:03:12,419 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bc9e63779e26ebe83703a775d914134f 2023-02-08 07:03:12,419 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-08 07:03:12,421 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,423 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-08 07:03:12,424 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-08 07:03:12,425 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,425 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-08 07:03:12,425 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839792425"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:12,427 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-08 07:03:12,427 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bc9e63779e26ebe83703a775d914134f, NAME => 'testInitTableSnapshotMapperJobConfig,,1675839790590.bc9e63779e26ebe83703a775d914134f.', STARTKEY => '', ENDKEY => ''}] 2023-02-08 07:03:12,427 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-08 07:03:12,427 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675839792427"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:12,430 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-08 07:03:12,432 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 07:03:12,433 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 32 msec 2023-02-08 07:03:12,504 INFO [Listener at localhost/43105] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:12,504 INFO [Listener at localhost/43105] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:12,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36283] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 07:03:12,505 INFO [Listener at localhost/43105] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-08 07:03:12,505 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 07:03:12,505 INFO [Listener at localhost/43105] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 07:03:12,506 DEBUG [Listener at localhost/43105] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x149b3c48 to 127.0.0.1:54442 2023-02-08 07:03:12,506 DEBUG [Listener at localhost/43105] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:12,506 DEBUG [Listener at localhost/43105] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 07:03:12,506 DEBUG [Listener at localhost/43105] util.JVMClusterUtil(257): Found active master hash=1043930295, stopped=false 2023-02-08 07:03:12,506 INFO [Listener at localhost/43105] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36283,1675839789271 2023-02-08 07:03:12,509 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:12,509 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:12,509 INFO [Listener at localhost/43105] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 07:03:12,509 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:12,510 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:12,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:12,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:12,511 DEBUG [Listener at localhost/43105] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1169fe3f to 127.0.0.1:54442 2023-02-08 07:03:12,511 DEBUG [Listener at localhost/43105] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:12,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:12,511 INFO [Listener at localhost/43105] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40013,1675839789318' ***** 2023-02-08 07:03:12,511 INFO [Listener at localhost/43105] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:03:12,511 INFO [Listener at localhost/43105] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36125,1675839789346' ***** 2023-02-08 07:03:12,512 INFO [Listener at localhost/43105] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:03:12,512 INFO [RS:0;jenkins-hbase4:40013] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:03:12,512 INFO [RS:1;jenkins-hbase4:36125] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:03:12,512 INFO [RS:0;jenkins-hbase4:40013] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:03:12,512 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:03:12,512 INFO [RS:0;jenkins-hbase4:40013] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:03:12,512 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:03:12,513 INFO [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(3304): Received CLOSE for ae371f4abe31e929b9fec6e1fbaaf987 2023-02-08 07:03:12,512 INFO [RS:1;jenkins-hbase4:36125] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:03:12,513 INFO [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:12,514 INFO [RS:1;jenkins-hbase4:36125] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:03:12,514 DEBUG [RS:0;jenkins-hbase4:40013] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d5fb508 to 127.0.0.1:54442 2023-02-08 07:03:12,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ae371f4abe31e929b9fec6e1fbaaf987, disabling compactions & flushes 2023-02-08 07:03:12,515 DEBUG [RS:0;jenkins-hbase4:40013] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:12,514 INFO [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:12,515 INFO [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 07:03:12,515 DEBUG [RS:1;jenkins-hbase4:36125] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b9aa108 to 127.0.0.1:54442 2023-02-08 07:03:12,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. 2023-02-08 07:03:12,515 DEBUG [RS:1;jenkins-hbase4:36125] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:12,515 DEBUG [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(1479): Online Regions={ae371f4abe31e929b9fec6e1fbaaf987=hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987.} 2023-02-08 07:03:12,515 INFO [RS:1;jenkins-hbase4:36125] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:03:12,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. 2023-02-08 07:03:12,515 INFO [RS:1;jenkins-hbase4:36125] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:03:12,515 DEBUG [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(1505): Waiting on ae371f4abe31e929b9fec6e1fbaaf987 2023-02-08 07:03:12,515 INFO [RS:1;jenkins-hbase4:36125] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:03:12,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. after waiting 0 ms 2023-02-08 07:03:12,515 INFO [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 07:03:12,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. 2023-02-08 07:03:12,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing ae371f4abe31e929b9fec6e1fbaaf987 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 07:03:12,516 INFO [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 07:03:12,516 DEBUG [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-08 07:03:12,516 DEBUG [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 07:03:12,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:03:12,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:03:12,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:03:12,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:03:12,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:03:12,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-08 07:03:12,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987/.tmp/info/630d9b639b404456a0d3061d65c73ad6 2023-02-08 07:03:12,526 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/.tmp/info/e01fdc5dd5d84f9585eddfd8587183c1 2023-02-08 07:03:12,530 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e01fdc5dd5d84f9585eddfd8587183c1 2023-02-08 07:03:12,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987/.tmp/info/630d9b639b404456a0d3061d65c73ad6 as hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987/info/630d9b639b404456a0d3061d65c73ad6 2023-02-08 07:03:12,536 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:12,536 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:12,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987/info/630d9b639b404456a0d3061d65c73ad6, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 07:03:12,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ae371f4abe31e929b9fec6e1fbaaf987 in 22ms, sequenceid=6, compaction requested=false 2023-02-08 07:03:12,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/namespace/ae371f4abe31e929b9fec6e1fbaaf987/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 07:03:12,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. 2023-02-08 07:03:12,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ae371f4abe31e929b9fec6e1fbaaf987: Waiting for close lock at 1675839792514Running coprocessor pre-close hooks at 1675839792514Disabling compacts and flushes for region at 1675839792514Disabling writes for close at 1675839792515 (+1 ms)Obtaining lock to block concurrent updates at 1675839792516 (+1 ms)Preparing flush snapshotting stores in ae371f4abe31e929b9fec6e1fbaaf987 at 1675839792516Finished memstore snapshotting hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675839792516Flushing stores of hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. at 1675839792517 (+1 ms)Flushing ae371f4abe31e929b9fec6e1fbaaf987/info: creating writer at 1675839792517Flushing ae371f4abe31e929b9fec6e1fbaaf987/info: appending metadata at 1675839792519 (+2 ms)Flushing ae371f4abe31e929b9fec6e1fbaaf987/info: closing flushed file at 1675839792519Flushing ae371f4abe31e929b9fec6e1fbaaf987/info: reopening flushed file at 1675839792532 (+13 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ae371f4abe31e929b9fec6e1fbaaf987 in 22ms, sequenceid=6, compaction requested=false at 1675839792537 (+5 ms)Writing region close event to WAL at 1675839792541 (+4 ms)Running coprocessor post-close hooks at 1675839792553 (+12 ms)Closed at 1675839792553 2023-02-08 07:03:12,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675839789932.ae371f4abe31e929b9fec6e1fbaaf987. 2023-02-08 07:03:12,554 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/.tmp/rep_barrier/56737441c6f5415cbb09641ecfcb7244 2023-02-08 07:03:12,558 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56737441c6f5415cbb09641ecfcb7244 2023-02-08 07:03:12,565 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/.tmp/table/d4e5055b2b96466fad50d0049feaa4b9 2023-02-08 07:03:12,569 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4e5055b2b96466fad50d0049feaa4b9 2023-02-08 07:03:12,570 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/.tmp/info/e01fdc5dd5d84f9585eddfd8587183c1 as hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/info/e01fdc5dd5d84f9585eddfd8587183c1 2023-02-08 07:03:12,574 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e01fdc5dd5d84f9585eddfd8587183c1 2023-02-08 07:03:12,574 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/info/e01fdc5dd5d84f9585eddfd8587183c1, entries=12, sequenceid=21, filesize=6.3 K 2023-02-08 07:03:12,575 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/.tmp/rep_barrier/56737441c6f5415cbb09641ecfcb7244 as hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/rep_barrier/56737441c6f5415cbb09641ecfcb7244 2023-02-08 07:03:12,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56737441c6f5415cbb09641ecfcb7244 2023-02-08 07:03:12,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/rep_barrier/56737441c6f5415cbb09641ecfcb7244, entries=1, sequenceid=21, filesize=5.0 K 2023-02-08 07:03:12,580 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/.tmp/table/d4e5055b2b96466fad50d0049feaa4b9 as hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/table/d4e5055b2b96466fad50d0049feaa4b9 2023-02-08 07:03:12,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4e5055b2b96466fad50d0049feaa4b9 2023-02-08 07:03:12,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/table/d4e5055b2b96466fad50d0049feaa4b9, entries=4, sequenceid=21, filesize=5.1 K 2023-02-08 07:03:12,585 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 69ms, sequenceid=21, compaction requested=false 2023-02-08 07:03:12,590 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-08 07:03:12,590 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 07:03:12,590 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:12,590 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839792516Running coprocessor pre-close hooks at 1675839792516Disabling compacts and flushes for region at 1675839792516Disabling writes for close at 1675839792516Obtaining lock to block concurrent updates at 1675839792516Preparing flush snapshotting stores in 1588230740 at 1675839792516Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1675839792517 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675839792517Flushing 1588230740/info: creating writer at 1675839792517Flushing 1588230740/info: appending metadata at 1675839792519 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675839792519Flushing 1588230740/rep_barrier: creating writer at 1675839792531 (+12 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675839792541 (+10 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675839792541Flushing 1588230740/table: creating writer at 1675839792558 (+17 ms)Flushing 1588230740/table: appending metadata at 1675839792560 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675839792560Flushing 1588230740/info: reopening flushed file at 1675839792570 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675839792575 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675839792580 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 69ms, sequenceid=21, compaction requested=false at 1675839792585 (+5 ms)Writing region close event to WAL at 1675839792587 (+2 ms)Running coprocessor post-close hooks at 1675839792590 (+3 ms)Closed at 1675839792590 2023-02-08 07:03:12,590 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:12,686 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-08 07:03:12,686 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-08 07:03:12,705 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-08 07:03:12,705 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-08 07:03:12,715 INFO [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40013,1675839789318; all regions closed. 2023-02-08 07:03:12,716 INFO [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36125,1675839789346; all regions closed. 2023-02-08 07:03:12,723 DEBUG [RS:0;jenkins-hbase4:40013] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/oldWALs 2023-02-08 07:03:12,723 INFO [RS:0;jenkins-hbase4:40013] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40013%2C1675839789318:(num 1675839790288) 2023-02-08 07:03:12,723 DEBUG [RS:0;jenkins-hbase4:40013] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:12,723 INFO [RS:0;jenkins-hbase4:40013] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:12,724 DEBUG [RS:1;jenkins-hbase4:36125] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/oldWALs 2023-02-08 07:03:12,724 INFO [RS:0;jenkins-hbase4:40013] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 07:03:12,724 INFO [RS:1;jenkins-hbase4:36125] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36125%2C1675839789346.meta:.meta(num 1675839789876) 2023-02-08 07:03:12,724 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:12,724 INFO [RS:0;jenkins-hbase4:40013] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:03:12,724 INFO [RS:0;jenkins-hbase4:40013] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:03:12,724 INFO [RS:0;jenkins-hbase4:40013] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:03:12,725 INFO [RS:0;jenkins-hbase4:40013] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40013 2023-02-08 07:03:12,727 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:12,727 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:12,727 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:12,727 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40013,1675839789318 2023-02-08 07:03:12,727 ERROR [Listener at localhost/43105-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a46475 rejected from java.util.concurrent.ThreadPoolExecutor@49bf0b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:12,728 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:12,728 ERROR [Listener at localhost/43105-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@53361867 rejected from java.util.concurrent.ThreadPoolExecutor@49bf0b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:12,728 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40013,1675839789318] 2023-02-08 07:03:12,728 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40013,1675839789318; numProcessing=1 2023-02-08 07:03:12,729 DEBUG [RS:1;jenkins-hbase4:36125] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/oldWALs 2023-02-08 07:03:12,729 INFO [RS:1;jenkins-hbase4:36125] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36125%2C1675839789346:(num 1675839790664) 2023-02-08 07:03:12,729 DEBUG [RS:1;jenkins-hbase4:36125] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:12,729 INFO [RS:1;jenkins-hbase4:36125] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:12,729 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40013,1675839789318 already deleted, retry=false 2023-02-08 07:03:12,730 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40013,1675839789318 expired; onlineServers=1 2023-02-08 07:03:12,730 INFO [RS:1;jenkins-hbase4:36125] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 07:03:12,730 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:12,730 INFO [RS:1;jenkins-hbase4:36125] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36125 2023-02-08 07:03:12,732 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36125,1675839789346 2023-02-08 07:03:12,732 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:12,732 ERROR [Listener at localhost/43105-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60c6ac70 rejected from java.util.concurrent.ThreadPoolExecutor@64f924b0[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:12,735 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36125,1675839789346] 2023-02-08 07:03:12,735 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36125,1675839789346; numProcessing=2 2023-02-08 07:03:12,737 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36125,1675839789346 already deleted, retry=false 2023-02-08 07:03:12,737 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36125,1675839789346 expired; onlineServers=0 2023-02-08 07:03:12,737 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36283,1675839789271' ***** 2023-02-08 07:03:12,737 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 07:03:12,737 DEBUG [M:0;jenkins-hbase4:36283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a068fa8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:12,737 INFO [M:0;jenkins-hbase4:36283] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36283,1675839789271 2023-02-08 07:03:12,737 INFO [M:0;jenkins-hbase4:36283] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36283,1675839789271; all regions closed. 2023-02-08 07:03:12,737 DEBUG [M:0;jenkins-hbase4:36283] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:12,737 DEBUG [M:0;jenkins-hbase4:36283] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 07:03:12,738 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 07:03:12,738 DEBUG [M:0;jenkins-hbase4:36283] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 07:03:12,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839789519] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839789519,5,FailOnTimeoutGroup] 2023-02-08 07:03:12,738 INFO [M:0;jenkins-hbase4:36283] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 07:03:12,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839789520] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839789520,5,FailOnTimeoutGroup] 2023-02-08 07:03:12,739 INFO [M:0;jenkins-hbase4:36283] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 07:03:12,739 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:12,739 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:12,739 INFO [M:0;jenkins-hbase4:36283] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 07:03:12,739 DEBUG [M:0;jenkins-hbase4:36283] master.HMaster(1502): Stopping service threads 2023-02-08 07:03:12,739 INFO [M:0;jenkins-hbase4:36283] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 07:03:12,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:12,739 ERROR [M:0;jenkins-hbase4:36283] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-08 07:03:12,740 INFO [M:0;jenkins-hbase4:36283] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 07:03:12,740 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 07:03:12,741 DEBUG [M:0;jenkins-hbase4:36283] zookeeper.ZKUtil(398): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 07:03:12,741 WARN [M:0;jenkins-hbase4:36283] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 07:03:12,741 INFO [M:0;jenkins-hbase4:36283] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 07:03:12,741 INFO [M:0;jenkins-hbase4:36283] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 07:03:12,741 DEBUG [M:0;jenkins-hbase4:36283] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:03:12,742 INFO [M:0;jenkins-hbase4:36283] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:12,742 DEBUG [M:0;jenkins-hbase4:36283] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:12,742 DEBUG [M:0;jenkins-hbase4:36283] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:03:12,742 DEBUG [M:0;jenkins-hbase4:36283] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:12,742 INFO [M:0;jenkins-hbase4:36283] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.85 KB 2023-02-08 07:03:12,751 INFO [M:0;jenkins-hbase4:36283] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5a9b367331b24b1e8b6bd025fe6a7006 2023-02-08 07:03:12,755 DEBUG [M:0;jenkins-hbase4:36283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5a9b367331b24b1e8b6bd025fe6a7006 as hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5a9b367331b24b1e8b6bd025fe6a7006 2023-02-08 07:03:12,759 INFO [M:0;jenkins-hbase4:36283] regionserver.HStore(1080): Added hdfs://localhost:43261/user/jenkins/test-data/5490b435-0335-de16-2eda-66ca49686984/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5a9b367331b24b1e8b6bd025fe6a7006, entries=17, sequenceid=132, filesize=8.7 K 2023-02-08 07:03:12,760 INFO [M:0;jenkins-hbase4:36283] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-08 07:03:12,760 INFO [M:0;jenkins-hbase4:36283] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:12,760 DEBUG [M:0;jenkins-hbase4:36283] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839792741Disabling compacts and flushes for region at 1675839792741Disabling writes for close at 1675839792742 (+1 ms)Obtaining lock to block concurrent updates at 1675839792742Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675839792742Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57248, getHeapSize=68440, getOffHeapSize=0, getCellsCount=145 at 1675839792742Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675839792743 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675839792743Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675839792745 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675839792745Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675839792756 (+11 ms)Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1675839792760 (+4 ms)Writing region close event to WAL at 1675839792760Closed at 1675839792760 2023-02-08 07:03:12,763 INFO [M:0;jenkins-hbase4:36283] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 07:03:12,763 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:12,764 INFO [M:0;jenkins-hbase4:36283] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36283 2023-02-08 07:03:12,765 DEBUG [M:0;jenkins-hbase4:36283] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36283,1675839789271 already deleted, retry=false 2023-02-08 07:03:13,009 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:13,009 INFO [M:0;jenkins-hbase4:36283] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36283,1675839789271; zookeeper connection closed. 2023-02-08 07:03:13,010 ERROR [Listener at localhost/43105-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43ab5d2a rejected from java.util.concurrent.ThreadPoolExecutor@4794c187[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:13,011 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): master:36283-0x10032bdc28a0000, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:13,011 ERROR [Listener at localhost/43105-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2a856ea6 rejected from java.util.concurrent.ThreadPoolExecutor@4794c187[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:13,110 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:13,110 INFO [RS:1;jenkins-hbase4:36125] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36125,1675839789346; zookeeper connection closed. 2023-02-08 07:03:13,110 ERROR [Listener at localhost/43105-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@456092fb rejected from java.util.concurrent.ThreadPoolExecutor@64f924b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:13,110 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:36125-0x10032bdc28a0002, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:13,110 ERROR [Listener at localhost/43105-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3de1690d rejected from java.util.concurrent.ThreadPoolExecutor@64f924b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:13,110 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@20e5c164] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@20e5c164 2023-02-08 07:03:13,210 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:13,210 INFO [RS:0;jenkins-hbase4:40013] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40013,1675839789318; zookeeper connection closed. 2023-02-08 07:03:13,210 ERROR [Listener at localhost/43105-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2b57613b rejected from java.util.concurrent.ThreadPoolExecutor@49bf0b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:13,210 DEBUG [Listener at localhost/43105-EventThread] zookeeper.ZKWatcher(600): regionserver:40013-0x10032bdc28a0001, quorum=127.0.0.1:54442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:13,210 ERROR [Listener at localhost/43105-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@42204070 rejected from java.util.concurrent.ThreadPoolExecutor@49bf0b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:13,210 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@42b290f0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@42b290f0 2023-02-08 07:03:13,210 INFO [Listener at localhost/43105] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 07:03:13,211 WARN [Listener at localhost/43105] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:03:13,214 INFO [Listener at localhost/43105] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:13,321 WARN [BP-598654776-172.31.14.131-1675839788717 heartbeating to localhost/127.0.0.1:43261] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:03:13,321 WARN [BP-598654776-172.31.14.131-1675839788717 heartbeating to localhost/127.0.0.1:43261] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-598654776-172.31.14.131-1675839788717 (Datanode Uuid 80ee05d1-10b6-4552-be05-ca03f7c8adec) service to localhost/127.0.0.1:43261 2023-02-08 07:03:13,322 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/cluster_0a41a84f-d676-858e-f2cf-1a9c9daf0107/dfs/data/data3/current/BP-598654776-172.31.14.131-1675839788717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:13,322 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/cluster_0a41a84f-d676-858e-f2cf-1a9c9daf0107/dfs/data/data4/current/BP-598654776-172.31.14.131-1675839788717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:13,324 WARN [Listener at localhost/43105] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:03:13,327 INFO [Listener at localhost/43105] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:13,431 WARN [BP-598654776-172.31.14.131-1675839788717 heartbeating to localhost/127.0.0.1:43261] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:03:13,431 WARN [BP-598654776-172.31.14.131-1675839788717 heartbeating to localhost/127.0.0.1:43261] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-598654776-172.31.14.131-1675839788717 (Datanode Uuid 100be329-8617-4929-8079-ffdbdf93118c) service to localhost/127.0.0.1:43261 2023-02-08 07:03:13,432 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/cluster_0a41a84f-d676-858e-f2cf-1a9c9daf0107/dfs/data/data1/current/BP-598654776-172.31.14.131-1675839788717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:13,432 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/cluster_0a41a84f-d676-858e-f2cf-1a9c9daf0107/dfs/data/data2/current/BP-598654776-172.31.14.131-1675839788717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:13,442 INFO [Listener at localhost/43105] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:13,555 INFO [Listener at localhost/43105] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 07:03:13,575 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 07:03:13,586 INFO [Listener at localhost/43105] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 155) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43105 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:43261 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43261 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:43261 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:43261 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:43261 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:43261 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36283,1675839789271)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:43261 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=565 (was 531) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=290 (was 306), ProcessCount=165 (was 165), AvailableMemoryMB=4338 (was 4380) 2023-02-08 07:03:13,595 INFO [Listener at localhost/43105] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=565, MaxFileDescriptor=60000, SystemLoadAverage=290, ProcessCount=165, AvailableMemoryMB=4338 2023-02-08 07:03:13,606 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/hadoop.log.dir so I do NOT create it in target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2 2023-02-08 07:03:13,606 WARN [Listener at localhost/43105] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/hadoop.log.dir Erasing configuration value by system value. 2023-02-08 07:03:13,606 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/hadoop.tmp.dir so I do NOT create it in target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2 2023-02-08 07:03:13,606 WARN [Listener at localhost/43105] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3c6b6703-f818-9436-3787-93f4cbbb4af5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-08 07:03:13,606 DEBUG [Listener at localhost/43105] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2 2023-02-08 07:03:13,606 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 07:03:13,606 INFO [Listener at localhost/43105] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/cluster_cc838893-e0fd-b676-e465-f73d7417b71a, deleteOnExit=true 2023-02-08 07:03:13,606 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 07:03:13,606 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/test.cache.data in system properties and HBase conf 2023-02-08 07:03:13,606 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 07:03:13,606 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/hadoop.log.dir in system properties and HBase conf 2023-02-08 07:03:13,606 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 07:03:13,607 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 07:03:13,607 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 07:03:13,607 DEBUG [Listener at localhost/43105] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 07:03:13,607 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:03:13,607 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:03:13,607 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 07:03:13,607 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:03:13,607 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 07:03:13,607 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 07:03:13,607 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:03:13,608 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:03:13,608 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 07:03:13,608 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/nfs.dump.dir in system properties and HBase conf 2023-02-08 07:03:13,608 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/java.io.tmpdir in system properties and HBase conf 2023-02-08 07:03:13,608 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:03:13,608 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 07:03:13,608 INFO [Listener at localhost/43105] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 07:03:13,612 WARN [Listener at localhost/43105] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:03:13,612 WARN [Listener at localhost/43105] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:03:13,652 WARN [Listener at localhost/43105] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:13,653 INFO [Listener at localhost/43105] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:13,658 INFO [Listener at localhost/43105] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/java.io.tmpdir/Jetty_localhost_46537_hdfs____.q3jrnj/webapp 2023-02-08 07:03:13,749 INFO [Listener at localhost/43105] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46537 2023-02-08 07:03:13,753 WARN [Listener at localhost/43105] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:03:13,753 WARN [Listener at localhost/43105] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:03:13,800 WARN [Listener at localhost/44939] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:13,813 WARN [Listener at localhost/44939] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:03:13,815 WARN [Listener at localhost/44939] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:13,816 INFO [Listener at localhost/44939] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:13,823 INFO [Listener at localhost/44939] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/java.io.tmpdir/Jetty_localhost_35739_datanode____.gpus0u/webapp 2023-02-08 07:03:13,920 INFO [Listener at localhost/44939] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35739 2023-02-08 07:03:13,931 WARN [Listener at localhost/40513] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:13,944 WARN [Listener at localhost/40513] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:03:13,945 WARN [Listener at localhost/40513] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:13,946 INFO [Listener at localhost/40513] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:13,949 INFO [Listener at localhost/40513] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/java.io.tmpdir/Jetty_localhost_43349_datanode____.eibpfk/webapp 2023-02-08 07:03:14,026 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8e120ee07c4b2e67: Processing first storage report for DS-0de1e88b-5b4f-4339-8e63-4db01595f58b from datanode c7a5e39e-6a6f-4b83-8213-5399f409785c 2023-02-08 07:03:14,026 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8e120ee07c4b2e67: from storage DS-0de1e88b-5b4f-4339-8e63-4db01595f58b node DatanodeRegistration(127.0.0.1:45619, datanodeUuid=c7a5e39e-6a6f-4b83-8213-5399f409785c, infoPort=40713, infoSecurePort=0, ipcPort=40513, storageInfo=lv=-57;cid=testClusterID;nsid=194507596;c=1675839793615), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:14,026 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8e120ee07c4b2e67: Processing first storage report for DS-e82ea7cf-69fd-472d-a0d7-a2c287e54207 from datanode c7a5e39e-6a6f-4b83-8213-5399f409785c 2023-02-08 07:03:14,026 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8e120ee07c4b2e67: from storage DS-e82ea7cf-69fd-472d-a0d7-a2c287e54207 node DatanodeRegistration(127.0.0.1:45619, datanodeUuid=c7a5e39e-6a6f-4b83-8213-5399f409785c, infoPort=40713, infoSecurePort=0, ipcPort=40513, storageInfo=lv=-57;cid=testClusterID;nsid=194507596;c=1675839793615), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:14,051 INFO [Listener at localhost/40513] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43349 2023-02-08 07:03:14,060 WARN [Listener at localhost/35563] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:14,158 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x56d7e5bad6ab5cd: Processing first storage report for DS-04a7846a-9fb8-44f3-a1e9-50ed826db92b from datanode 73dfd131-0a78-4f90-adb8-4334f33bb4b8 2023-02-08 07:03:14,158 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x56d7e5bad6ab5cd: from storage DS-04a7846a-9fb8-44f3-a1e9-50ed826db92b node DatanodeRegistration(127.0.0.1:36521, datanodeUuid=73dfd131-0a78-4f90-adb8-4334f33bb4b8, infoPort=45483, infoSecurePort=0, ipcPort=35563, storageInfo=lv=-57;cid=testClusterID;nsid=194507596;c=1675839793615), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:14,158 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x56d7e5bad6ab5cd: Processing first storage report for DS-30e4ba65-e35c-412e-8fdc-c84253a26dbd from datanode 73dfd131-0a78-4f90-adb8-4334f33bb4b8 2023-02-08 07:03:14,158 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x56d7e5bad6ab5cd: from storage DS-30e4ba65-e35c-412e-8fdc-c84253a26dbd node DatanodeRegistration(127.0.0.1:36521, datanodeUuid=73dfd131-0a78-4f90-adb8-4334f33bb4b8, infoPort=45483, infoSecurePort=0, ipcPort=35563, storageInfo=lv=-57;cid=testClusterID;nsid=194507596;c=1675839793615), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:14,169 DEBUG [Listener at localhost/35563] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2 2023-02-08 07:03:14,171 INFO [Listener at localhost/35563] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/cluster_cc838893-e0fd-b676-e465-f73d7417b71a/zookeeper_0, clientPort=60124, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/cluster_cc838893-e0fd-b676-e465-f73d7417b71a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/cluster_cc838893-e0fd-b676-e465-f73d7417b71a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 07:03:14,172 INFO [Listener at localhost/35563] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60124 2023-02-08 07:03:14,172 INFO [Listener at localhost/35563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:14,173 INFO [Listener at localhost/35563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:14,187 INFO [Listener at localhost/35563] util.FSUtils(479): Created version file at hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871 with version=8 2023-02-08 07:03:14,187 INFO [Listener at localhost/35563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:14,188 INFO [Listener at localhost/35563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:14,189 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/hbase-staging 2023-02-08 07:03:14,190 INFO [Listener at localhost/35563] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:14,190 INFO [Listener at localhost/35563] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:14,190 INFO [Listener at localhost/35563] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:14,190 INFO [Listener at localhost/35563] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:14,191 INFO [Listener at localhost/35563] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:14,191 INFO [Listener at localhost/35563] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:14,191 INFO [Listener at localhost/35563] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:14,191 INFO [Listener at localhost/35563] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43147 2023-02-08 07:03:14,192 INFO [Listener at localhost/35563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:14,193 INFO [Listener at localhost/35563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:14,193 INFO [Listener at localhost/35563] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43147 connecting to ZooKeeper ensemble=127.0.0.1:60124 2023-02-08 07:03:14,202 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:431470x0, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:14,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43147-0x10032bdd5bf0000 connected 2023-02-08 07:03:14,220 DEBUG [Listener at localhost/35563] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:14,220 DEBUG [Listener at localhost/35563] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:14,220 DEBUG [Listener at localhost/35563] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:14,224 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43147 2023-02-08 07:03:14,224 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43147 2023-02-08 07:03:14,226 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43147 2023-02-08 07:03:14,226 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43147 2023-02-08 07:03:14,226 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43147 2023-02-08 07:03:14,226 INFO [Listener at localhost/35563] master.HMaster(439): hbase.rootdir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871, hbase.cluster.distributed=false 2023-02-08 07:03:14,238 INFO [Listener at localhost/35563] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:14,238 INFO [Listener at localhost/35563] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:14,238 INFO [Listener at localhost/35563] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:14,239 INFO [Listener at localhost/35563] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:14,239 INFO [Listener at localhost/35563] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:14,239 INFO [Listener at localhost/35563] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:14,239 INFO [Listener at localhost/35563] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:14,239 INFO [Listener at localhost/35563] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35101 2023-02-08 07:03:14,240 INFO [Listener at localhost/35563] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:03:14,241 DEBUG [Listener at localhost/35563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:14,241 INFO [Listener at localhost/35563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:14,242 INFO [Listener at localhost/35563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:14,243 INFO [Listener at localhost/35563] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35101 connecting to ZooKeeper ensemble=127.0.0.1:60124 2023-02-08 07:03:14,246 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:351010x0, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:14,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35101-0x10032bdd5bf0001 connected 2023-02-08 07:03:14,248 DEBUG [Listener at localhost/35563] zookeeper.ZKUtil(164): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:14,248 DEBUG [Listener at localhost/35563] zookeeper.ZKUtil(164): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:14,249 DEBUG [Listener at localhost/35563] zookeeper.ZKUtil(164): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:14,252 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35101 2023-02-08 07:03:14,252 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35101 2023-02-08 07:03:14,256 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35101 2023-02-08 07:03:14,256 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35101 2023-02-08 07:03:14,256 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35101 2023-02-08 07:03:14,267 INFO [Listener at localhost/35563] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:14,267 INFO [Listener at localhost/35563] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:14,267 INFO [Listener at localhost/35563] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:14,267 INFO [Listener at localhost/35563] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:14,267 INFO [Listener at localhost/35563] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:14,267 INFO [Listener at localhost/35563] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:14,267 INFO [Listener at localhost/35563] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:14,268 INFO [Listener at localhost/35563] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43331 2023-02-08 07:03:14,268 INFO [Listener at localhost/35563] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:03:14,269 DEBUG [Listener at localhost/35563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:14,269 INFO [Listener at localhost/35563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:14,270 INFO [Listener at localhost/35563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:14,271 INFO [Listener at localhost/35563] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43331 connecting to ZooKeeper ensemble=127.0.0.1:60124 2023-02-08 07:03:14,274 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:433310x0, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:14,275 DEBUG [Listener at localhost/35563] zookeeper.ZKUtil(164): regionserver:433310x0, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:14,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43331-0x10032bdd5bf0002 connected 2023-02-08 07:03:14,276 DEBUG [Listener at localhost/35563] zookeeper.ZKUtil(164): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:14,276 DEBUG [Listener at localhost/35563] zookeeper.ZKUtil(164): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:14,279 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43331 2023-02-08 07:03:14,280 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43331 2023-02-08 07:03:14,280 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43331 2023-02-08 07:03:14,284 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43331 2023-02-08 07:03:14,284 DEBUG [Listener at localhost/35563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43331 2023-02-08 07:03:14,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43147,1675839794190 2023-02-08 07:03:14,290 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:03:14,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43147,1675839794190 2023-02-08 07:03:14,292 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:14,292 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:14,292 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:14,292 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:14,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:03:14,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43147,1675839794190 from backup master directory 2023-02-08 07:03:14,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:03:14,296 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43147,1675839794190 2023-02-08 07:03:14,296 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:14,296 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:03:14,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,43147,1675839794190 2023-02-08 07:03:14,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/hbase.id with ID: a38f7e37-dc3a-4d23-836b-75cdcd8fb211 2023-02-08 07:03:14,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:14,323 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:14,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x681b923c to 127.0.0.1:60124 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:14,339 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@599ad645, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:14,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:14,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 07:03:14,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:14,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/data/master/store-tmp 2023-02-08 07:03:14,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:14,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:03:14,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:14,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:14,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:03:14,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:14,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:14,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839794350Disabling compacts and flushes for region at 1675839794350Disabling writes for close at 1675839794350Writing region close event to WAL at 1675839794350Closed at 1675839794350 2023-02-08 07:03:14,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/WALs/jenkins-hbase4.apache.org,43147,1675839794190 2023-02-08 07:03:14,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43147%2C1675839794190, suffix=, logDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/WALs/jenkins-hbase4.apache.org,43147,1675839794190, archiveDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/oldWALs, maxLogs=10 2023-02-08 07:03:14,367 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45619,DS-0de1e88b-5b4f-4339-8e63-4db01595f58b,DISK] 2023-02-08 07:03:14,367 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36521,DS-04a7846a-9fb8-44f3-a1e9-50ed826db92b,DISK] 2023-02-08 07:03:14,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/WALs/jenkins-hbase4.apache.org,43147,1675839794190/jenkins-hbase4.apache.org%2C43147%2C1675839794190.1675839794354 2023-02-08 07:03:14,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36521,DS-04a7846a-9fb8-44f3-a1e9-50ed826db92b,DISK], DatanodeInfoWithStorage[127.0.0.1:45619,DS-0de1e88b-5b4f-4339-8e63-4db01595f58b,DISK]] 2023-02-08 07:03:14,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:14,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:14,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:14,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:14,371 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:14,373 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 07:03:14,373 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 07:03:14,374 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:14,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:14,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:14,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:14,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:14,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60806123, jitterRate=-0.09391815960407257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:03:14,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675839794370Initializing all the Stores at 1675839794371 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839794371Cleaning up temporary data from old regions at 1675839794375 (+4 ms)Cleaning up detritus from prior splits at 1675839794375Region opened successfully at 1675839794380 (+5 ms) 2023-02-08 07:03:14,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 07:03:14,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 07:03:14,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 07:03:14,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 07:03:14,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-08 07:03:14,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-08 07:03:14,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 07:03:14,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 07:03:14,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 07:03:14,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 07:03:14,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 07:03:14,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 07:03:14,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 07:03:14,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 07:03:14,396 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:14,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 07:03:14,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 07:03:14,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 07:03:14,399 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:14,399 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:14,399 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:14,400 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:14,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,43147,1675839794190, sessionid=0x10032bdd5bf0000, setting cluster-up flag (Was=false) 2023-02-08 07:03:14,404 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:14,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 07:03:14,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43147,1675839794190 2023-02-08 07:03:14,412 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:14,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 07:03:14,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43147,1675839794190 2023-02-08 07:03:14,417 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.hbase-snapshot/.tmp 2023-02-08 07:03:14,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:14,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:14,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:14,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:14,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:14,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 07:03:14,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:14,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675839824421 2023-02-08 07:03:14,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 07:03:14,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 07:03:14,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 07:03:14,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 07:03:14,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 07:03:14,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 07:03:14,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 07:03:14,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 07:03:14,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 07:03:14,423 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:14,423 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 07:03:14,424 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:14,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 07:03:14,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 07:03:14,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839794425,5,FailOnTimeoutGroup] 2023-02-08 07:03:14,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839794426,5,FailOnTimeoutGroup] 2023-02-08 07:03:14,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 07:03:14,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,438 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:14,439 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:14,439 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871 2023-02-08 07:03:14,450 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:14,451 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:03:14,452 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/info 2023-02-08 07:03:14,452 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:03:14,453 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:14,453 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:03:14,454 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:14,455 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:03:14,455 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:14,455 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:03:14,456 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/table 2023-02-08 07:03:14,456 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:03:14,457 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:14,457 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740 2023-02-08 07:03:14,458 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740 2023-02-08 07:03:14,460 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:03:14,461 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:03:14,462 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:14,463 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75383662, jitterRate=0.1233040988445282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:03:14,463 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675839794450Initializing all the Stores at 1675839794451 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839794451Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839794451Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839794451Cleaning up temporary data from old regions at 1675839794458 (+7 ms)Cleaning up detritus from prior splits at 1675839794459 (+1 ms)Region opened successfully at 1675839794463 (+4 ms) 2023-02-08 07:03:14,463 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:03:14,463 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:03:14,463 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:03:14,463 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:03:14,463 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:03:14,463 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:14,463 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839794463Disabling compacts and flushes for region at 1675839794463Disabling writes for close at 1675839794463Writing region close event to WAL at 1675839794463Closed at 1675839794463 2023-02-08 07:03:14,464 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:14,464 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 07:03:14,464 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 07:03:14,466 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 07:03:14,467 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 07:03:14,489 INFO [RS:1;jenkins-hbase4:43331] regionserver.HRegionServer(952): ClusterId : a38f7e37-dc3a-4d23-836b-75cdcd8fb211 2023-02-08 07:03:14,489 INFO [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(952): ClusterId : a38f7e37-dc3a-4d23-836b-75cdcd8fb211 2023-02-08 07:03:14,490 DEBUG [RS:1;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:03:14,490 DEBUG [RS:0;jenkins-hbase4:35101] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:03:14,491 DEBUG [RS:1;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:03:14,491 DEBUG [RS:0;jenkins-hbase4:35101] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:03:14,492 DEBUG [RS:0;jenkins-hbase4:35101] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:03:14,492 DEBUG [RS:1;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:03:14,494 DEBUG [RS:1;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:03:14,494 DEBUG [RS:0;jenkins-hbase4:35101] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:03:14,496 DEBUG [RS:0;jenkins-hbase4:35101] zookeeper.ReadOnlyZKClient(139): Connect 0x67dd27a3 to 127.0.0.1:60124 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:14,496 DEBUG [RS:1;jenkins-hbase4:43331] zookeeper.ReadOnlyZKClient(139): Connect 0x13e529f9 to 127.0.0.1:60124 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:14,504 DEBUG [RS:0;jenkins-hbase4:35101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@691ad528, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:14,504 DEBUG [RS:0;jenkins-hbase4:35101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d254cd3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:14,504 DEBUG [RS:1;jenkins-hbase4:43331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d22c5f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:14,504 DEBUG [RS:1;jenkins-hbase4:43331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@191d4289, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:14,513 DEBUG [RS:0;jenkins-hbase4:35101] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35101 2023-02-08 07:03:14,513 INFO [RS:0;jenkins-hbase4:35101] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:03:14,513 INFO [RS:0;jenkins-hbase4:35101] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:03:14,513 DEBUG [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:03:14,513 INFO [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43147,1675839794190 with isa=jenkins-hbase4.apache.org/172.31.14.131:35101, startcode=1675839794238 2023-02-08 07:03:14,513 DEBUG [RS:0;jenkins-hbase4:35101] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:03:14,513 DEBUG [RS:1;jenkins-hbase4:43331] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43331 2023-02-08 07:03:14,514 INFO [RS:1;jenkins-hbase4:43331] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:03:14,514 INFO [RS:1;jenkins-hbase4:43331] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:03:14,514 DEBUG [RS:1;jenkins-hbase4:43331] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:03:14,514 INFO [RS:1;jenkins-hbase4:43331] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43147,1675839794190 with isa=jenkins-hbase4.apache.org/172.31.14.131:43331, startcode=1675839794266 2023-02-08 07:03:14,514 DEBUG [RS:1;jenkins-hbase4:43331] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:03:14,516 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44131, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:03:14,516 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34989, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:03:14,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43147] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:14,517 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:14,518 DEBUG [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871 2023-02-08 07:03:14,518 DEBUG [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44939 2023-02-08 07:03:14,518 DEBUG [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:03:14,518 DEBUG [RS:1;jenkins-hbase4:43331] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871 2023-02-08 07:03:14,518 DEBUG [RS:1;jenkins-hbase4:43331] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44939 2023-02-08 07:03:14,518 DEBUG [RS:1;jenkins-hbase4:43331] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:03:14,523 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:14,523 DEBUG [RS:0;jenkins-hbase4:35101] zookeeper.ZKUtil(162): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:14,523 DEBUG [RS:1;jenkins-hbase4:43331] zookeeper.ZKUtil(162): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:14,523 WARN [RS:0;jenkins-hbase4:35101] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:14,523 WARN [RS:1;jenkins-hbase4:43331] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:14,524 INFO [RS:0;jenkins-hbase4:35101] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:14,524 INFO [RS:1;jenkins-hbase4:43331] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:14,524 DEBUG [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/WALs/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:14,524 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43331,1675839794266] 2023-02-08 07:03:14,524 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35101,1675839794238] 2023-02-08 07:03:14,524 DEBUG [RS:1;jenkins-hbase4:43331] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/WALs/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:14,530 DEBUG [RS:0;jenkins-hbase4:35101] zookeeper.ZKUtil(162): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:14,530 DEBUG [RS:1;jenkins-hbase4:43331] zookeeper.ZKUtil(162): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:14,530 DEBUG [RS:0;jenkins-hbase4:35101] zookeeper.ZKUtil(162): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:14,530 DEBUG [RS:1;jenkins-hbase4:43331] zookeeper.ZKUtil(162): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:14,531 DEBUG [RS:0;jenkins-hbase4:35101] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:03:14,531 DEBUG [RS:1;jenkins-hbase4:43331] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:03:14,531 INFO [RS:0;jenkins-hbase4:35101] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:03:14,531 INFO [RS:1;jenkins-hbase4:43331] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:03:14,533 INFO [RS:0;jenkins-hbase4:35101] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:03:14,533 INFO [RS:0;jenkins-hbase4:35101] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:03:14,533 INFO [RS:0;jenkins-hbase4:35101] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,533 INFO [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:03:14,534 INFO [RS:1;jenkins-hbase4:43331] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:03:14,536 INFO [RS:1;jenkins-hbase4:43331] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:03:14,536 INFO [RS:0;jenkins-hbase4:35101] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,536 INFO [RS:1;jenkins-hbase4:43331] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,536 DEBUG [RS:0;jenkins-hbase4:35101] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,536 DEBUG [RS:0;jenkins-hbase4:35101] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,536 DEBUG [RS:0;jenkins-hbase4:35101] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,536 DEBUG [RS:0;jenkins-hbase4:35101] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,536 DEBUG [RS:0;jenkins-hbase4:35101] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,536 DEBUG [RS:0;jenkins-hbase4:35101] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:14,536 DEBUG [RS:0;jenkins-hbase4:35101] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,536 DEBUG [RS:0;jenkins-hbase4:35101] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,536 DEBUG [RS:0;jenkins-hbase4:35101] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,537 DEBUG [RS:0;jenkins-hbase4:35101] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,539 INFO [RS:1;jenkins-hbase4:43331] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:03:14,540 INFO [RS:0;jenkins-hbase4:35101] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,540 INFO [RS:0;jenkins-hbase4:35101] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,541 INFO [RS:0;jenkins-hbase4:35101] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,541 INFO [RS:1;jenkins-hbase4:43331] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,541 DEBUG [RS:1;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,541 DEBUG [RS:1;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,541 DEBUG [RS:1;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,541 DEBUG [RS:1;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,541 DEBUG [RS:1;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,541 DEBUG [RS:1;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:14,541 DEBUG [RS:1;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,541 DEBUG [RS:1;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,541 DEBUG [RS:1;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,541 DEBUG [RS:1;jenkins-hbase4:43331] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:14,544 INFO [RS:1;jenkins-hbase4:43331] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,544 INFO [RS:1;jenkins-hbase4:43331] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,544 INFO [RS:1;jenkins-hbase4:43331] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,545 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 07:03:14,551 INFO [RS:0;jenkins-hbase4:35101] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:03:14,552 INFO [RS:0;jenkins-hbase4:35101] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35101,1675839794238-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,554 INFO [RS:1;jenkins-hbase4:43331] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:03:14,554 INFO [RS:1;jenkins-hbase4:43331] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43331,1675839794266-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,564 INFO [RS:0;jenkins-hbase4:35101] regionserver.Replication(203): jenkins-hbase4.apache.org,35101,1675839794238 started 2023-02-08 07:03:14,564 INFO [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35101,1675839794238, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35101, sessionid=0x10032bdd5bf0001 2023-02-08 07:03:14,564 DEBUG [RS:0;jenkins-hbase4:35101] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:03:14,564 DEBUG [RS:0;jenkins-hbase4:35101] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:14,564 DEBUG [RS:0;jenkins-hbase4:35101] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35101,1675839794238' 2023-02-08 07:03:14,564 DEBUG [RS:0;jenkins-hbase4:35101] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:14,564 DEBUG [RS:0;jenkins-hbase4:35101] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:14,564 INFO [RS:1;jenkins-hbase4:43331] regionserver.Replication(203): jenkins-hbase4.apache.org,43331,1675839794266 started 2023-02-08 07:03:14,564 INFO [RS:1;jenkins-hbase4:43331] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43331,1675839794266, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43331, sessionid=0x10032bdd5bf0002 2023-02-08 07:03:14,565 DEBUG [RS:1;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:03:14,565 DEBUG [RS:0;jenkins-hbase4:35101] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:03:14,565 DEBUG [RS:1;jenkins-hbase4:43331] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:14,565 DEBUG [RS:1;jenkins-hbase4:43331] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43331,1675839794266' 2023-02-08 07:03:14,565 DEBUG [RS:1;jenkins-hbase4:43331] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:14,565 DEBUG [RS:0;jenkins-hbase4:35101] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:03:14,565 DEBUG [RS:0;jenkins-hbase4:35101] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:14,565 DEBUG [RS:0;jenkins-hbase4:35101] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35101,1675839794238' 2023-02-08 07:03:14,565 DEBUG [RS:0;jenkins-hbase4:35101] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:14,565 DEBUG [RS:1;jenkins-hbase4:43331] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:14,565 DEBUG [RS:0;jenkins-hbase4:35101] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:14,565 DEBUG [RS:1;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:03:14,565 DEBUG [RS:1;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:03:14,566 DEBUG [RS:0;jenkins-hbase4:35101] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:03:14,566 DEBUG [RS:1;jenkins-hbase4:43331] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:14,566 DEBUG [RS:1;jenkins-hbase4:43331] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43331,1675839794266' 2023-02-08 07:03:14,566 DEBUG [RS:1;jenkins-hbase4:43331] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:14,566 INFO [RS:0;jenkins-hbase4:35101] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:03:14,566 INFO [RS:0;jenkins-hbase4:35101] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:03:14,566 DEBUG [RS:1;jenkins-hbase4:43331] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:14,566 DEBUG [RS:1;jenkins-hbase4:43331] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:03:14,566 INFO [RS:1;jenkins-hbase4:43331] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:03:14,566 INFO [RS:1;jenkins-hbase4:43331] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:03:14,618 DEBUG [jenkins-hbase4:43147] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 07:03:14,618 DEBUG [jenkins-hbase4:43147] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:14,619 DEBUG [jenkins-hbase4:43147] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:14,619 DEBUG [jenkins-hbase4:43147] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:14,619 DEBUG [jenkins-hbase4:43147] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:14,620 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35101,1675839794238, state=OPENING 2023-02-08 07:03:14,622 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 07:03:14,623 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:14,623 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:03:14,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35101,1675839794238}] 2023-02-08 07:03:14,778 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:14,778 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:03:14,780 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57294, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:03:14,784 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 07:03:14,784 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:14,786 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35101%2C1675839794238.meta, suffix=.meta, logDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/WALs/jenkins-hbase4.apache.org,35101,1675839794238, archiveDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/oldWALs, maxLogs=32 2023-02-08 07:03:14,806 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36521,DS-04a7846a-9fb8-44f3-a1e9-50ed826db92b,DISK] 2023-02-08 07:03:14,806 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45619,DS-0de1e88b-5b4f-4339-8e63-4db01595f58b,DISK] 2023-02-08 07:03:14,808 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/WALs/jenkins-hbase4.apache.org,35101,1675839794238/jenkins-hbase4.apache.org%2C35101%2C1675839794238.meta.1675839794786.meta 2023-02-08 07:03:14,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36521,DS-04a7846a-9fb8-44f3-a1e9-50ed826db92b,DISK], DatanodeInfoWithStorage[127.0.0.1:45619,DS-0de1e88b-5b4f-4339-8e63-4db01595f58b,DISK]] 2023-02-08 07:03:14,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:14,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 07:03:14,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 07:03:14,809 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 07:03:14,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 07:03:14,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:14,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 07:03:14,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 07:03:14,810 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:03:14,811 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/info 2023-02-08 07:03:14,811 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/info 2023-02-08 07:03:14,811 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:03:14,812 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:14,812 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:03:14,813 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:14,813 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:14,813 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:03:14,814 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:14,814 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:03:14,815 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/table 2023-02-08 07:03:14,815 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/table 2023-02-08 07:03:14,815 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:03:14,815 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:14,816 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740 2023-02-08 07:03:14,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740 2023-02-08 07:03:14,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:03:14,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:03:14,821 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62998113, jitterRate=-0.06125496327877045}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:03:14,821 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675839794809Writing region info on filesystem at 1675839794809Initializing all the Stores at 1675839794810 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839794810Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839794810Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839794810Cleaning up temporary data from old regions at 1675839794818 (+8 ms)Cleaning up detritus from prior splits at 1675839794819 (+1 ms)Running coprocessor post-open hooks at 1675839794821 (+2 ms)Region opened successfully at 1675839794821 2023-02-08 07:03:14,822 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675839794778 2023-02-08 07:03:14,828 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 07:03:14,828 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 07:03:14,828 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35101,1675839794238, state=OPEN 2023-02-08 07:03:14,829 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 07:03:14,830 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:03:14,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 07:03:14,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35101,1675839794238 in 207 msec 2023-02-08 07:03:14,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 07:03:14,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 367 msec 2023-02-08 07:03:14,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 415 msec 2023-02-08 07:03:14,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675839794290, completionTime=-1 2023-02-08 07:03:14,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 07:03:14,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 07:03:14,836 DEBUG [hconnection-0x4dec1daa-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:14,838 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57304, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:14,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 07:03:14,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675839854839 2023-02-08 07:03:14,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675839914839 2023-02-08 07:03:14,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-08 07:03:14,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43147,1675839794190-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43147,1675839794190-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43147,1675839794190-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43147, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:14,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 07:03:14,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:14,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 07:03:14,850 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 07:03:14,850 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:03:14,851 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:03:14,852 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/hbase/namespace/c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:14,853 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/hbase/namespace/c871baa28df9de81a06c856049d02e24 empty. 2023-02-08 07:03:14,853 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/hbase/namespace/c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:14,853 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 07:03:14,873 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:14,874 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c871baa28df9de81a06c856049d02e24, NAME => 'hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp 2023-02-08 07:03:14,884 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:14,884 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c871baa28df9de81a06c856049d02e24, disabling compactions & flushes 2023-02-08 07:03:14,884 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. 2023-02-08 07:03:14,884 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. 2023-02-08 07:03:14,884 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. after waiting 0 ms 2023-02-08 07:03:14,884 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. 2023-02-08 07:03:14,884 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. 2023-02-08 07:03:14,884 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c871baa28df9de81a06c856049d02e24: Waiting for close lock at 1675839794884Disabling compacts and flushes for region at 1675839794884Disabling writes for close at 1675839794884Writing region close event to WAL at 1675839794884Closed at 1675839794884 2023-02-08 07:03:14,887 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:03:14,889 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839794889"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839794889"}]},"ts":"1675839794889"} 2023-02-08 07:03:14,892 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 07:03:14,893 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:03:14,893 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839794893"}]},"ts":"1675839794893"} 2023-02-08 07:03:14,895 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 07:03:14,898 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:14,899 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:14,899 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:14,899 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:14,901 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c871baa28df9de81a06c856049d02e24, ASSIGN}] 2023-02-08 07:03:14,903 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c871baa28df9de81a06c856049d02e24, ASSIGN 2023-02-08 07:03:14,904 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c871baa28df9de81a06c856049d02e24, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35101,1675839794238; forceNewPlan=false, retain=false 2023-02-08 07:03:15,054 INFO [jenkins-hbase4:43147] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 07:03:15,056 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c871baa28df9de81a06c856049d02e24, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:15,056 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839795056"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839795056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839795056"}]},"ts":"1675839795056"} 2023-02-08 07:03:15,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c871baa28df9de81a06c856049d02e24, server=jenkins-hbase4.apache.org,35101,1675839794238}] 2023-02-08 07:03:15,213 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. 2023-02-08 07:03:15,217 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35101%2C1675839794238, suffix=, logDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/WALs/jenkins-hbase4.apache.org,35101,1675839794238, archiveDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/oldWALs, maxLogs=32 2023-02-08 07:03:15,230 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36521,DS-04a7846a-9fb8-44f3-a1e9-50ed826db92b,DISK] 2023-02-08 07:03:15,230 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45619,DS-0de1e88b-5b4f-4339-8e63-4db01595f58b,DISK] 2023-02-08 07:03:15,231 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/WALs/jenkins-hbase4.apache.org,35101,1675839794238/jenkins-hbase4.apache.org%2C35101%2C1675839794238.1675839795218 2023-02-08 07:03:15,231 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36521,DS-04a7846a-9fb8-44f3-a1e9-50ed826db92b,DISK], DatanodeInfoWithStorage[127.0.0.1:45619,DS-0de1e88b-5b4f-4339-8e63-4db01595f58b,DISK]] 2023-02-08 07:03:15,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c871baa28df9de81a06c856049d02e24, NAME => 'hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:15,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:15,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:15,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:15,236 INFO [StoreOpener-c871baa28df9de81a06c856049d02e24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:15,237 DEBUG [StoreOpener-c871baa28df9de81a06c856049d02e24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/namespace/c871baa28df9de81a06c856049d02e24/info 2023-02-08 07:03:15,237 DEBUG [StoreOpener-c871baa28df9de81a06c856049d02e24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/namespace/c871baa28df9de81a06c856049d02e24/info 2023-02-08 07:03:15,238 INFO [StoreOpener-c871baa28df9de81a06c856049d02e24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c871baa28df9de81a06c856049d02e24 columnFamilyName info 2023-02-08 07:03:15,238 INFO [StoreOpener-c871baa28df9de81a06c856049d02e24-1] regionserver.HStore(310): Store=c871baa28df9de81a06c856049d02e24/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:15,239 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/namespace/c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:15,239 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/namespace/c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:15,242 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:15,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/namespace/c871baa28df9de81a06c856049d02e24/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:15,245 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c871baa28df9de81a06c856049d02e24; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59333182, jitterRate=-0.11586669087409973}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:03:15,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c871baa28df9de81a06c856049d02e24: Running coprocessor pre-open hook at 1675839795232Writing region info on filesystem at 1675839795232Initializing all the Stores at 1675839795233 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839795233Cleaning up temporary data from old regions at 1675839795240 (+7 ms)Cleaning up detritus from prior splits at 1675839795240Running coprocessor post-open hooks at 1675839795245 (+5 ms)Region opened successfully at 1675839795245 2023-02-08 07:03:15,246 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24., pid=6, masterSystemTime=1675839795210 2023-02-08 07:03:15,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. 2023-02-08 07:03:15,248 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. 2023-02-08 07:03:15,249 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c871baa28df9de81a06c856049d02e24, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:15,249 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839795248"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839795248"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839795248"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839795248"}]},"ts":"1675839795248"} 2023-02-08 07:03:15,252 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 07:03:15,252 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c871baa28df9de81a06c856049d02e24, server=jenkins-hbase4.apache.org,35101,1675839794238 in 192 msec 2023-02-08 07:03:15,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 07:03:15,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c871baa28df9de81a06c856049d02e24, ASSIGN in 353 msec 2023-02-08 07:03:15,255 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:03:15,255 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839795255"}]},"ts":"1675839795255"} 2023-02-08 07:03:15,257 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 07:03:15,260 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:03:15,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 412 msec 2023-02-08 07:03:15,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 07:03:15,351 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:15,351 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:15,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 07:03:15,363 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:15,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-08 07:03:15,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 07:03:15,375 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:15,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-08 07:03:15,391 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 07:03:15,395 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 07:03:15,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.099sec 2023-02-08 07:03:15,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 07:03:15,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 07:03:15,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 07:03:15,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43147,1675839794190-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 07:03:15,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43147,1675839794190-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 07:03:15,396 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-08 07:03:15,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 07:03:15,490 DEBUG [Listener at localhost/35563] zookeeper.ReadOnlyZKClient(139): Connect 0x25711d63 to 127.0.0.1:60124 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:15,495 DEBUG [Listener at localhost/35563] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26587e08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:15,497 DEBUG [hconnection-0x728f52ef-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:15,498 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57316, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:15,500 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43147,1675839794190 2023-02-08 07:03:15,500 DEBUG [Listener at localhost/35563] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 07:03:15,500 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:15,500 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:15,502 DEBUG [Listener at localhost/35563] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 07:03:15,503 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46292, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 07:03:15,504 INFO [Listener at localhost/35563] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-08 07:03:15,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-08 07:03:15,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 07:03:15,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:46292 deadline: 1675839855504, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-08 07:03:15,505 INFO [Listener at localhost/35563] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-08 07:03:15,505 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:15,505 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:15,507 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:15,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:15,510 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:03:15,510 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-08 07:03:15,511 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:15,511 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:15,511 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:03:15,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:15,518 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:15,518 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:15,518 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:15,518 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:15,518 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:15,518 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:15,518 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:15,518 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:15,519 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23 empty. 2023-02-08 07:03:15,519 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6 empty. 2023-02-08 07:03:15,519 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9 empty. 2023-02-08 07:03:15,519 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183 empty. 2023-02-08 07:03:15,519 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23 empty. 2023-02-08 07:03:15,520 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf empty. 2023-02-08 07:03:15,520 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3 empty. 2023-02-08 07:03:15,520 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:15,520 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:15,520 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:15,520 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:15,520 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:15,520 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da empty. 2023-02-08 07:03:15,521 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:15,521 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0 empty. 2023-02-08 07:03:15,521 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca empty. 2023-02-08 07:03:15,521 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:15,521 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:15,521 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:15,521 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:15,521 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:15,521 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:15,521 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-08 07:03:15,536 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:15,537 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 84049d23f1836ed1456960a4993876e6, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp 2023-02-08 07:03:15,538 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => bd93a30a19626092a69882fcdac58e23, NAME => 'testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp 2023-02-08 07:03:15,538 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => ef8f74b75cb8a75fb50619be90b2fdca, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp 2023-02-08 07:03:15,554 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing ef8f74b75cb8a75fb50619be90b2fdca, disabling compactions & flushes 2023-02-08 07:03:15,555 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:15,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:15,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. after waiting 0 ms 2023-02-08 07:03:15,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:15,555 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:15,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for ef8f74b75cb8a75fb50619be90b2fdca: Waiting for close lock at 1675839795555Disabling compacts and flushes for region at 1675839795555Disabling writes for close at 1675839795555Writing region close event to WAL at 1675839795555Closed at 1675839795555 2023-02-08 07:03:15,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 84049d23f1836ed1456960a4993876e6, disabling compactions & flushes 2023-02-08 07:03:15,555 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:15,555 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 26575cad1b966bdf12197b7268a90ea9, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp 2023-02-08 07:03:15,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:15,556 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. after waiting 0 ms 2023-02-08 07:03:15,556 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:15,556 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:15,556 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 84049d23f1836ed1456960a4993876e6: Waiting for close lock at 1675839795555Disabling compacts and flushes for region at 1675839795555Disabling writes for close at 1675839795556 (+1 ms)Writing region close event to WAL at 1675839795556Closed at 1675839795556 2023-02-08 07:03:15,556 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4801b4e0c43dd2e3ec7a967389c4b183, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp 2023-02-08 07:03:15,556 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,556 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing bd93a30a19626092a69882fcdac58e23, disabling compactions & flushes 2023-02-08 07:03:15,557 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:15,557 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:15,557 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. after waiting 0 ms 2023-02-08 07:03:15,557 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:15,557 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:15,557 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for bd93a30a19626092a69882fcdac58e23: Waiting for close lock at 1675839795556Disabling compacts and flushes for region at 1675839795556Disabling writes for close at 1675839795557 (+1 ms)Writing region close event to WAL at 1675839795557Closed at 1675839795557 2023-02-08 07:03:15,557 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 88b0ea7c06e199f4ac7f9f7b48dd93f3, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp 2023-02-08 07:03:15,568 INFO [RS:1;jenkins-hbase4:43331] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43331%2C1675839794266, suffix=, logDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/WALs/jenkins-hbase4.apache.org,43331,1675839794266, archiveDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/oldWALs, maxLogs=32 2023-02-08 07:03:15,572 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,572 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,572 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 4801b4e0c43dd2e3ec7a967389c4b183, disabling compactions & flushes 2023-02-08 07:03:15,572 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 26575cad1b966bdf12197b7268a90ea9, disabling compactions & flushes 2023-02-08 07:03:15,572 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:15,572 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:15,572 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. after waiting 0 ms 2023-02-08 07:03:15,572 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:15,572 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:15,572 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 26575cad1b966bdf12197b7268a90ea9: Waiting for close lock at 1675839795572Disabling compacts and flushes for region at 1675839795572Disabling writes for close at 1675839795572Writing region close event to WAL at 1675839795572Closed at 1675839795572 2023-02-08 07:03:15,573 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => c344d75b5acd95336c6451dc11c34e23, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp 2023-02-08 07:03:15,572 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:15,573 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:15,573 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. after waiting 0 ms 2023-02-08 07:03:15,573 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:15,573 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:15,573 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 4801b4e0c43dd2e3ec7a967389c4b183: Waiting for close lock at 1675839795572Disabling compacts and flushes for region at 1675839795572Disabling writes for close at 1675839795573 (+1 ms)Writing region close event to WAL at 1675839795573Closed at 1675839795573 2023-02-08 07:03:15,574 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 52d462aa8eb46c1b3d5399c511d8a9bf, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp 2023-02-08 07:03:15,584 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,584 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 88b0ea7c06e199f4ac7f9f7b48dd93f3, disabling compactions & flushes 2023-02-08 07:03:15,584 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:15,584 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:15,584 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. after waiting 0 ms 2023-02-08 07:03:15,584 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:15,585 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:15,585 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 88b0ea7c06e199f4ac7f9f7b48dd93f3: Waiting for close lock at 1675839795584Disabling compacts and flushes for region at 1675839795584Disabling writes for close at 1675839795584Writing region close event to WAL at 1675839795585 (+1 ms)Closed at 1675839795585 2023-02-08 07:03:15,585 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 941a8a477ea07d4f8905b62789d933da, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp 2023-02-08 07:03:15,597 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,597 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 52d462aa8eb46c1b3d5399c511d8a9bf, disabling compactions & flushes 2023-02-08 07:03:15,597 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:15,597 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:15,597 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. after waiting 0 ms 2023-02-08 07:03:15,598 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:15,598 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:15,598 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 52d462aa8eb46c1b3d5399c511d8a9bf: Waiting for close lock at 1675839795597Disabling compacts and flushes for region at 1675839795597Disabling writes for close at 1675839795598 (+1 ms)Writing region close event to WAL at 1675839795598Closed at 1675839795598 2023-02-08 07:03:15,598 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => b90e49fec73de744aae2309c072367e0, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp 2023-02-08 07:03:15,604 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,604 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing c344d75b5acd95336c6451dc11c34e23, disabling compactions & flushes 2023-02-08 07:03:15,604 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:15,604 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:15,604 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. after waiting 0 ms 2023-02-08 07:03:15,604 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:15,604 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:15,604 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for c344d75b5acd95336c6451dc11c34e23: Waiting for close lock at 1675839795604Disabling compacts and flushes for region at 1675839795604Disabling writes for close at 1675839795604Writing region close event to WAL at 1675839795604Closed at 1675839795604 2023-02-08 07:03:15,611 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36521,DS-04a7846a-9fb8-44f3-a1e9-50ed826db92b,DISK] 2023-02-08 07:03:15,611 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45619,DS-0de1e88b-5b4f-4339-8e63-4db01595f58b,DISK] 2023-02-08 07:03:15,612 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:15,612 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:15,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:15,617 INFO [RS:1;jenkins-hbase4:43331] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/WALs/jenkins-hbase4.apache.org,43331,1675839794266/jenkins-hbase4.apache.org%2C43331%2C1675839794266.1675839795568 2023-02-08 07:03:15,622 DEBUG [RS:1;jenkins-hbase4:43331] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45619,DS-0de1e88b-5b4f-4339-8e63-4db01595f58b,DISK], DatanodeInfoWithStorage[127.0.0.1:36521,DS-04a7846a-9fb8-44f3-a1e9-50ed826db92b,DISK]] 2023-02-08 07:03:15,623 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,623 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 941a8a477ea07d4f8905b62789d933da, disabling compactions & flushes 2023-02-08 07:03:15,623 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:15,623 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:15,623 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. after waiting 0 ms 2023-02-08 07:03:15,623 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:15,623 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:15,623 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 941a8a477ea07d4f8905b62789d933da: Waiting for close lock at 1675839795623Disabling compacts and flushes for region at 1675839795623Disabling writes for close at 1675839795623Writing region close event to WAL at 1675839795623Closed at 1675839795623 2023-02-08 07:03:15,624 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,624 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing b90e49fec73de744aae2309c072367e0, disabling compactions & flushes 2023-02-08 07:03:15,625 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:15,625 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:15,625 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. after waiting 0 ms 2023-02-08 07:03:15,625 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:15,625 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:15,625 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for b90e49fec73de744aae2309c072367e0: Waiting for close lock at 1675839795624Disabling compacts and flushes for region at 1675839795624Disabling writes for close at 1675839795625 (+1 ms)Writing region close event to WAL at 1675839795625Closed at 1675839795625 2023-02-08 07:03:15,627 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:03:15,628 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839795628"}]},"ts":"1675839795628"} 2023-02-08 07:03:15,628 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675839795507.84049d23f1836ed1456960a4993876e6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839795628"}]},"ts":"1675839795628"} 2023-02-08 07:03:15,628 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675839795628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839795628"}]},"ts":"1675839795628"} 2023-02-08 07:03:15,628 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839795628"}]},"ts":"1675839795628"} 2023-02-08 07:03:15,628 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839795628"}]},"ts":"1675839795628"} 2023-02-08 07:03:15,628 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839795628"}]},"ts":"1675839795628"} 2023-02-08 07:03:15,628 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839795628"}]},"ts":"1675839795628"} 2023-02-08 07:03:15,628 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839795628"}]},"ts":"1675839795628"} 2023-02-08 07:03:15,629 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839795628"}]},"ts":"1675839795628"} 2023-02-08 07:03:15,629 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675839795628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839795628"}]},"ts":"1675839795628"} 2023-02-08 07:03:15,631 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-08 07:03:15,631 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:03:15,631 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839795631"}]},"ts":"1675839795631"} 2023-02-08 07:03:15,633 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-08 07:03:15,637 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:15,643 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:15,643 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:15,643 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:15,643 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bd93a30a19626092a69882fcdac58e23, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef8f74b75cb8a75fb50619be90b2fdca, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84049d23f1836ed1456960a4993876e6, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=26575cad1b966bdf12197b7268a90ea9, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4801b4e0c43dd2e3ec7a967389c4b183, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=88b0ea7c06e199f4ac7f9f7b48dd93f3, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c344d75b5acd95336c6451dc11c34e23, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=52d462aa8eb46c1b3d5399c511d8a9bf, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=941a8a477ea07d4f8905b62789d933da, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b90e49fec73de744aae2309c072367e0, ASSIGN}] 2023-02-08 07:03:15,646 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b90e49fec73de744aae2309c072367e0, ASSIGN 2023-02-08 07:03:15,646 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=941a8a477ea07d4f8905b62789d933da, ASSIGN 2023-02-08 07:03:15,646 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=52d462aa8eb46c1b3d5399c511d8a9bf, ASSIGN 2023-02-08 07:03:15,646 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c344d75b5acd95336c6451dc11c34e23, ASSIGN 2023-02-08 07:03:15,646 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=88b0ea7c06e199f4ac7f9f7b48dd93f3, ASSIGN 2023-02-08 07:03:15,646 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b90e49fec73de744aae2309c072367e0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43331,1675839794266; forceNewPlan=false, retain=false 2023-02-08 07:03:15,646 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=52d462aa8eb46c1b3d5399c511d8a9bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35101,1675839794238; forceNewPlan=false, retain=false 2023-02-08 07:03:15,646 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=941a8a477ea07d4f8905b62789d933da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35101,1675839794238; forceNewPlan=false, retain=false 2023-02-08 07:03:15,647 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c344d75b5acd95336c6451dc11c34e23, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43331,1675839794266; forceNewPlan=false, retain=false 2023-02-08 07:03:15,647 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4801b4e0c43dd2e3ec7a967389c4b183, ASSIGN 2023-02-08 07:03:15,647 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=88b0ea7c06e199f4ac7f9f7b48dd93f3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43331,1675839794266; forceNewPlan=false, retain=false 2023-02-08 07:03:15,647 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=26575cad1b966bdf12197b7268a90ea9, ASSIGN 2023-02-08 07:03:15,647 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84049d23f1836ed1456960a4993876e6, ASSIGN 2023-02-08 07:03:15,649 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef8f74b75cb8a75fb50619be90b2fdca, ASSIGN 2023-02-08 07:03:15,649 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4801b4e0c43dd2e3ec7a967389c4b183, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35101,1675839794238; forceNewPlan=false, retain=false 2023-02-08 07:03:15,649 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bd93a30a19626092a69882fcdac58e23, ASSIGN 2023-02-08 07:03:15,649 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=26575cad1b966bdf12197b7268a90ea9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43331,1675839794266; forceNewPlan=false, retain=false 2023-02-08 07:03:15,649 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84049d23f1836ed1456960a4993876e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43331,1675839794266; forceNewPlan=false, retain=false 2023-02-08 07:03:15,650 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef8f74b75cb8a75fb50619be90b2fdca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35101,1675839794238; forceNewPlan=false, retain=false 2023-02-08 07:03:15,650 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bd93a30a19626092a69882fcdac58e23, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35101,1675839794238; forceNewPlan=false, retain=false 2023-02-08 07:03:15,797 INFO [jenkins-hbase4:43147] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-08 07:03:15,803 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c344d75b5acd95336c6451dc11c34e23, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:15,803 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=88b0ea7c06e199f4ac7f9f7b48dd93f3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:15,803 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b90e49fec73de744aae2309c072367e0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:15,803 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=84049d23f1836ed1456960a4993876e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:15,803 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795803"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839795803"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839795803"}]},"ts":"1675839795803"} 2023-02-08 07:03:15,803 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675839795507.84049d23f1836ed1456960a4993876e6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795803"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839795803"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839795803"}]},"ts":"1675839795803"} 2023-02-08 07:03:15,803 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=26575cad1b966bdf12197b7268a90ea9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:15,803 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675839795803"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839795803"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839795803"}]},"ts":"1675839795803"} 2023-02-08 07:03:15,803 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795803"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839795803"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839795803"}]},"ts":"1675839795803"} 2023-02-08 07:03:15,803 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795803"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839795803"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839795803"}]},"ts":"1675839795803"} 2023-02-08 07:03:15,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure 88b0ea7c06e199f4ac7f9f7b48dd93f3, server=jenkins-hbase4.apache.org,43331,1675839794266}] 2023-02-08 07:03:15,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure 84049d23f1836ed1456960a4993876e6, server=jenkins-hbase4.apache.org,43331,1675839794266}] 2023-02-08 07:03:15,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure b90e49fec73de744aae2309c072367e0, server=jenkins-hbase4.apache.org,43331,1675839794266}] 2023-02-08 07:03:15,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure c344d75b5acd95336c6451dc11c34e23, server=jenkins-hbase4.apache.org,43331,1675839794266}] 2023-02-08 07:03:15,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure 26575cad1b966bdf12197b7268a90ea9, server=jenkins-hbase4.apache.org,43331,1675839794266}] 2023-02-08 07:03:15,808 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=941a8a477ea07d4f8905b62789d933da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:15,809 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795808"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839795808"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839795808"}]},"ts":"1675839795808"} 2023-02-08 07:03:15,809 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4801b4e0c43dd2e3ec7a967389c4b183, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:15,809 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795809"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839795809"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839795809"}]},"ts":"1675839795809"} 2023-02-08 07:03:15,810 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=52d462aa8eb46c1b3d5399c511d8a9bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:15,810 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bd93a30a19626092a69882fcdac58e23, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:15,810 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795810"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839795810"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839795810"}]},"ts":"1675839795810"} 2023-02-08 07:03:15,810 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure 941a8a477ea07d4f8905b62789d933da, server=jenkins-hbase4.apache.org,35101,1675839794238}] 2023-02-08 07:03:15,810 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675839795810"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839795810"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839795810"}]},"ts":"1675839795810"} 2023-02-08 07:03:15,811 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=15, state=RUNNABLE; OpenRegionProcedure 4801b4e0c43dd2e3ec7a967389c4b183, server=jenkins-hbase4.apache.org,35101,1675839794238}] 2023-02-08 07:03:15,811 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ef8f74b75cb8a75fb50619be90b2fdca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:15,811 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795811"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839795811"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839795811"}]},"ts":"1675839795811"} 2023-02-08 07:03:15,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 52d462aa8eb46c1b3d5399c511d8a9bf, server=jenkins-hbase4.apache.org,35101,1675839794238}] 2023-02-08 07:03:15,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=11, state=RUNNABLE; OpenRegionProcedure bd93a30a19626092a69882fcdac58e23, server=jenkins-hbase4.apache.org,35101,1675839794238}] 2023-02-08 07:03:15,813 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:15,814 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:15,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=12, state=RUNNABLE; OpenRegionProcedure ef8f74b75cb8a75fb50619be90b2fdca, server=jenkins-hbase4.apache.org,35101,1675839794238}] 2023-02-08 07:03:15,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:15,957 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:15,957 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:03:15,959 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:03:15,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:15,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b90e49fec73de744aae2309c072367e0, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-08 07:03:15,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:15,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:15,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:15,964 INFO [StoreOpener-b90e49fec73de744aae2309c072367e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:15,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:15,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 941a8a477ea07d4f8905b62789d933da, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-08 07:03:15,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:15,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:15,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:15,965 DEBUG [StoreOpener-b90e49fec73de744aae2309c072367e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/f1 2023-02-08 07:03:15,966 DEBUG [StoreOpener-b90e49fec73de744aae2309c072367e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/f1 2023-02-08 07:03:15,966 INFO [StoreOpener-b90e49fec73de744aae2309c072367e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b90e49fec73de744aae2309c072367e0 columnFamilyName f1 2023-02-08 07:03:15,966 INFO [StoreOpener-b90e49fec73de744aae2309c072367e0-1] regionserver.HStore(310): Store=b90e49fec73de744aae2309c072367e0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:15,967 INFO [StoreOpener-b90e49fec73de744aae2309c072367e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:15,967 INFO [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:15,968 DEBUG [StoreOpener-b90e49fec73de744aae2309c072367e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/f2 2023-02-08 07:03:15,968 DEBUG [StoreOpener-b90e49fec73de744aae2309c072367e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/f2 2023-02-08 07:03:15,968 INFO [StoreOpener-b90e49fec73de744aae2309c072367e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b90e49fec73de744aae2309c072367e0 columnFamilyName f2 2023-02-08 07:03:15,968 DEBUG [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1 2023-02-08 07:03:15,968 DEBUG [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1 2023-02-08 07:03:15,969 INFO [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 941a8a477ea07d4f8905b62789d933da columnFamilyName f1 2023-02-08 07:03:15,969 INFO [StoreOpener-b90e49fec73de744aae2309c072367e0-1] regionserver.HStore(310): Store=b90e49fec73de744aae2309c072367e0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:15,969 INFO [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] regionserver.HStore(310): Store=941a8a477ea07d4f8905b62789d933da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:15,969 INFO [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:15,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:15,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:15,970 DEBUG [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2 2023-02-08 07:03:15,970 DEBUG [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2 2023-02-08 07:03:15,971 INFO [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 941a8a477ea07d4f8905b62789d933da columnFamilyName f2 2023-02-08 07:03:15,971 INFO [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] regionserver.HStore(310): Store=941a8a477ea07d4f8905b62789d933da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:15,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:15,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:15,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:15,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:15,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:15,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:15,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b90e49fec73de744aae2309c072367e0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59193140, jitterRate=-0.11795347929000854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:15,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:15,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b90e49fec73de744aae2309c072367e0: Running coprocessor pre-open hook at 1675839795963Writing region info on filesystem at 1675839795963Initializing all the Stores at 1675839795964 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839795964Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839795964Cleaning up temporary data from old regions at 1675839795970 (+6 ms)Cleaning up detritus from prior splits at 1675839795971 (+1 ms)Running coprocessor post-open hooks at 1675839795975 (+4 ms)Region opened successfully at 1675839795975 2023-02-08 07:03:15,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0., pid=23, masterSystemTime=1675839795957 2023-02-08 07:03:15,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:15,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 941a8a477ea07d4f8905b62789d933da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62345005, jitterRate=-0.0709870308637619}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:15,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 941a8a477ea07d4f8905b62789d933da: Running coprocessor pre-open hook at 1675839795965Writing region info on filesystem at 1675839795965Initializing all the Stores at 1675839795966 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839795966Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839795967 (+1 ms)Cleaning up temporary data from old regions at 1675839795973 (+6 ms)Cleaning up detritus from prior splits at 1675839795973Running coprocessor post-open hooks at 1675839795978 (+5 ms)Region opened successfully at 1675839795978 2023-02-08 07:03:15,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da., pid=26, masterSystemTime=1675839795962 2023-02-08 07:03:15,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:15,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:15,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:15,981 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b90e49fec73de744aae2309c072367e0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:15,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 84049d23f1836ed1456960a4993876e6, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-08 07:03:15,981 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675839795981"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839795981"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839795981"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839795981"}]},"ts":"1675839795981"} 2023-02-08 07:03:15,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:15,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:15,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:15,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:15,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:15,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:15,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 52d462aa8eb46c1b3d5399c511d8a9bf, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-08 07:03:15,982 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=941a8a477ea07d4f8905b62789d933da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:15,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:15,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,982 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795981"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839795981"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839795981"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839795981"}]},"ts":"1675839795981"} 2023-02-08 07:03:15,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:15,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:15,983 INFO [StoreOpener-84049d23f1836ed1456960a4993876e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:15,983 INFO [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:15,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-08 07:03:15,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure b90e49fec73de744aae2309c072367e0, server=jenkins-hbase4.apache.org,43331,1675839794266 in 176 msec 2023-02-08 07:03:15,984 DEBUG [StoreOpener-84049d23f1836ed1456960a4993876e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1 2023-02-08 07:03:15,984 DEBUG [StoreOpener-84049d23f1836ed1456960a4993876e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1 2023-02-08 07:03:15,985 DEBUG [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1 2023-02-08 07:03:15,985 DEBUG [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1 2023-02-08 07:03:15,985 INFO [StoreOpener-84049d23f1836ed1456960a4993876e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84049d23f1836ed1456960a4993876e6 columnFamilyName f1 2023-02-08 07:03:15,985 INFO [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52d462aa8eb46c1b3d5399c511d8a9bf columnFamilyName f1 2023-02-08 07:03:15,985 INFO [StoreOpener-84049d23f1836ed1456960a4993876e6-1] regionserver.HStore(310): Store=84049d23f1836ed1456960a4993876e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:15,985 INFO [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] regionserver.HStore(310): Store=52d462aa8eb46c1b3d5399c511d8a9bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:15,985 INFO [StoreOpener-84049d23f1836ed1456960a4993876e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:15,985 INFO [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:15,987 DEBUG [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2 2023-02-08 07:03:15,987 DEBUG [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2 2023-02-08 07:03:15,987 DEBUG [StoreOpener-84049d23f1836ed1456960a4993876e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2 2023-02-08 07:03:15,987 DEBUG [StoreOpener-84049d23f1836ed1456960a4993876e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2 2023-02-08 07:03:15,987 INFO [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52d462aa8eb46c1b3d5399c511d8a9bf columnFamilyName f2 2023-02-08 07:03:15,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-08 07:03:15,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure 941a8a477ea07d4f8905b62789d933da, server=jenkins-hbase4.apache.org,35101,1675839794238 in 173 msec 2023-02-08 07:03:15,987 INFO [StoreOpener-84049d23f1836ed1456960a4993876e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84049d23f1836ed1456960a4993876e6 columnFamilyName f2 2023-02-08 07:03:15,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b90e49fec73de744aae2309c072367e0, ASSIGN in 341 msec 2023-02-08 07:03:15,987 INFO [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] regionserver.HStore(310): Store=52d462aa8eb46c1b3d5399c511d8a9bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:15,988 INFO [StoreOpener-84049d23f1836ed1456960a4993876e6-1] regionserver.HStore(310): Store=84049d23f1836ed1456960a4993876e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:15,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=941a8a477ea07d4f8905b62789d933da, ASSIGN in 344 msec 2023-02-08 07:03:15,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:15,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:15,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:15,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:15,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:15,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:15,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:15,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:15,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:15,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:15,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 52d462aa8eb46c1b3d5399c511d8a9bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68227898, jitterRate=0.016674906015396118}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:15,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 52d462aa8eb46c1b3d5399c511d8a9bf: Running coprocessor pre-open hook at 1675839795982Writing region info on filesystem at 1675839795982Initializing all the Stores at 1675839795983 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839795983Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839795983Cleaning up temporary data from old regions at 1675839795989 (+6 ms)Cleaning up detritus from prior splits at 1675839795989Running coprocessor post-open hooks at 1675839795994 (+5 ms)Region opened successfully at 1675839795994 2023-02-08 07:03:15,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 84049d23f1836ed1456960a4993876e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61723218, jitterRate=-0.08025237917900085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:15,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 84049d23f1836ed1456960a4993876e6: Running coprocessor pre-open hook at 1675839795981Writing region info on filesystem at 1675839795981Initializing all the Stores at 1675839795983 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839795983Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839795983Cleaning up temporary data from old regions at 1675839795989 (+6 ms)Cleaning up detritus from prior splits at 1675839795990 (+1 ms)Running coprocessor post-open hooks at 1675839795994 (+4 ms)Region opened successfully at 1675839795994 2023-02-08 07:03:15,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6., pid=22, masterSystemTime=1675839795957 2023-02-08 07:03:15,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf., pid=28, masterSystemTime=1675839795962 2023-02-08 07:03:15,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:15,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:15,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:15,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c344d75b5acd95336c6451dc11c34e23, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-08 07:03:15,996 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=84049d23f1836ed1456960a4993876e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:15,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:15,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,997 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675839795507.84049d23f1836ed1456960a4993876e6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795996"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839795996"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839795996"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839795996"}]},"ts":"1675839795996"} 2023-02-08 07:03:15,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:15,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:15,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:15,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:15,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:15,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ef8f74b75cb8a75fb50619be90b2fdca, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-08 07:03:15,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:15,998 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=52d462aa8eb46c1b3d5399c511d8a9bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:15,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:15,998 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839795997"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839795997"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839795997"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839795997"}]},"ts":"1675839795997"} 2023-02-08 07:03:15,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:15,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:15,999 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-08 07:03:16,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure 84049d23f1836ed1456960a4993876e6, server=jenkins-hbase4.apache.org,43331,1675839794266 in 193 msec 2023-02-08 07:03:16,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-08 07:03:16,001 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84049d23f1836ed1456960a4993876e6, ASSIGN in 357 msec 2023-02-08 07:03:16,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 52d462aa8eb46c1b3d5399c511d8a9bf, server=jenkins-hbase4.apache.org,35101,1675839794238 in 187 msec 2023-02-08 07:03:16,002 INFO [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:16,002 INFO [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:16,003 DEBUG [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1 2023-02-08 07:03:16,003 DEBUG [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1 2023-02-08 07:03:16,003 DEBUG [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1 2023-02-08 07:03:16,004 DEBUG [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1 2023-02-08 07:03:16,004 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=52d462aa8eb46c1b3d5399c511d8a9bf, ASSIGN in 358 msec 2023-02-08 07:03:16,004 INFO [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef8f74b75cb8a75fb50619be90b2fdca columnFamilyName f1 2023-02-08 07:03:16,004 INFO [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c344d75b5acd95336c6451dc11c34e23 columnFamilyName f1 2023-02-08 07:03:16,004 INFO [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] regionserver.HStore(310): Store=ef8f74b75cb8a75fb50619be90b2fdca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:16,004 INFO [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] regionserver.HStore(310): Store=c344d75b5acd95336c6451dc11c34e23/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:16,004 INFO [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:16,004 INFO [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:16,005 DEBUG [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2 2023-02-08 07:03:16,005 DEBUG [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2 2023-02-08 07:03:16,005 DEBUG [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2 2023-02-08 07:03:16,005 DEBUG [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2 2023-02-08 07:03:16,006 INFO [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c344d75b5acd95336c6451dc11c34e23 columnFamilyName f2 2023-02-08 07:03:16,006 INFO [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef8f74b75cb8a75fb50619be90b2fdca columnFamilyName f2 2023-02-08 07:03:16,006 INFO [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] regionserver.HStore(310): Store=c344d75b5acd95336c6451dc11c34e23/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:16,006 INFO [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] regionserver.HStore(310): Store=ef8f74b75cb8a75fb50619be90b2fdca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:16,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:16,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:16,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:16,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:16,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:16,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:16,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:16,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:16,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:16,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:16,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c344d75b5acd95336c6451dc11c34e23; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67543904, jitterRate=0.006482601165771484}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:16,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c344d75b5acd95336c6451dc11c34e23: Running coprocessor pre-open hook at 1675839795997Writing region info on filesystem at 1675839795997Initializing all the Stores at 1675839795998 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839795998Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839796002 (+4 ms)Cleaning up temporary data from old regions at 1675839796008 (+6 ms)Cleaning up detritus from prior splits at 1675839796008Running coprocessor post-open hooks at 1675839796012 (+4 ms)Region opened successfully at 1675839796012 2023-02-08 07:03:16,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ef8f74b75cb8a75fb50619be90b2fdca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59688580, jitterRate=-0.11057084798812866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:16,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ef8f74b75cb8a75fb50619be90b2fdca: Running coprocessor pre-open hook at 1675839795998Writing region info on filesystem at 1675839795998Initializing all the Stores at 1675839795999 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839795999Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839796002 (+3 ms)Cleaning up temporary data from old regions at 1675839796008 (+6 ms)Cleaning up detritus from prior splits at 1675839796008Running coprocessor post-open hooks at 1675839796012 (+4 ms)Region opened successfully at 1675839796012 2023-02-08 07:03:16,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23., pid=24, masterSystemTime=1675839795957 2023-02-08 07:03:16,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca., pid=30, masterSystemTime=1675839795962 2023-02-08 07:03:16,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:16,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:16,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:16,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 26575cad1b966bdf12197b7268a90ea9, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-08 07:03:16,014 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c344d75b5acd95336c6451dc11c34e23, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:16,014 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839796014"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839796014"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839796014"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839796014"}]},"ts":"1675839796014"} 2023-02-08 07:03:16,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:16,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:16,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:16,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:16,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:16,016 INFO [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:16,018 DEBUG [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1 2023-02-08 07:03:16,018 DEBUG [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1 2023-02-08 07:03:16,018 INFO [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26575cad1b966bdf12197b7268a90ea9 columnFamilyName f1 2023-02-08 07:03:16,019 INFO [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] regionserver.HStore(310): Store=26575cad1b966bdf12197b7268a90ea9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:16,019 INFO [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:16,020 DEBUG [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2 2023-02-08 07:03:16,021 DEBUG [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2 2023-02-08 07:03:16,021 INFO [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26575cad1b966bdf12197b7268a90ea9 columnFamilyName f2 2023-02-08 07:03:16,021 INFO [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] regionserver.HStore(310): Store=26575cad1b966bdf12197b7268a90ea9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:16,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:16,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:16,023 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ef8f74b75cb8a75fb50619be90b2fdca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,023 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839796023"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839796023"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839796023"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839796023"}]},"ts":"1675839796023"} 2023-02-08 07:03:16,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-08 07:03:16,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:16,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure c344d75b5acd95336c6451dc11c34e23, server=jenkins-hbase4.apache.org,43331,1675839794266 in 210 msec 2023-02-08 07:03:16,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bd93a30a19626092a69882fcdac58e23, NAME => 'testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-08 07:03:16,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:16,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:16,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:16,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:16,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c344d75b5acd95336c6451dc11c34e23, ASSIGN in 381 msec 2023-02-08 07:03:16,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:16,026 INFO [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:16,026 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=12 2023-02-08 07:03:16,026 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=12, state=SUCCESS; OpenRegionProcedure ef8f74b75cb8a75fb50619be90b2fdca, server=jenkins-hbase4.apache.org,35101,1675839794238 in 211 msec 2023-02-08 07:03:16,027 DEBUG [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/f1 2023-02-08 07:03:16,027 DEBUG [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/f1 2023-02-08 07:03:16,028 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef8f74b75cb8a75fb50619be90b2fdca, ASSIGN in 383 msec 2023-02-08 07:03:16,028 INFO [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd93a30a19626092a69882fcdac58e23 columnFamilyName f1 2023-02-08 07:03:16,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:16,029 INFO [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] regionserver.HStore(310): Store=bd93a30a19626092a69882fcdac58e23/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:16,029 INFO [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:16,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:16,030 DEBUG [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/f2 2023-02-08 07:03:16,030 DEBUG [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/f2 2023-02-08 07:03:16,030 INFO [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd93a30a19626092a69882fcdac58e23 columnFamilyName f2 2023-02-08 07:03:16,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 26575cad1b966bdf12197b7268a90ea9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59757719, jitterRate=-0.10954059660434723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:16,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 26575cad1b966bdf12197b7268a90ea9: Running coprocessor pre-open hook at 1675839796015Writing region info on filesystem at 1675839796015Initializing all the Stores at 1675839796015Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839796016 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839796016Cleaning up temporary data from old regions at 1675839796023 (+7 ms)Cleaning up detritus from prior splits at 1675839796025 (+2 ms)Running coprocessor post-open hooks at 1675839796030 (+5 ms)Region opened successfully at 1675839796030 2023-02-08 07:03:16,031 INFO [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] regionserver.HStore(310): Store=bd93a30a19626092a69882fcdac58e23/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:16,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9., pid=25, masterSystemTime=1675839795957 2023-02-08 07:03:16,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:16,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:16,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:16,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:16,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:16,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 88b0ea7c06e199f4ac7f9f7b48dd93f3, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-08 07:03:16,033 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=26575cad1b966bdf12197b7268a90ea9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:16,033 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839796033"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839796033"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839796033"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839796033"}]},"ts":"1675839796033"} 2023-02-08 07:03:16,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:16,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:16,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:16,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:16,034 INFO [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:16,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:16,036 DEBUG [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1 2023-02-08 07:03:16,036 DEBUG [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1 2023-02-08 07:03:16,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-08 07:03:16,036 INFO [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88b0ea7c06e199f4ac7f9f7b48dd93f3 columnFamilyName f1 2023-02-08 07:03:16,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure 26575cad1b966bdf12197b7268a90ea9, server=jenkins-hbase4.apache.org,43331,1675839794266 in 226 msec 2023-02-08 07:03:16,037 INFO [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] regionserver.HStore(310): Store=88b0ea7c06e199f4ac7f9f7b48dd93f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:16,037 INFO [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:16,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=26575cad1b966bdf12197b7268a90ea9, ASSIGN in 393 msec 2023-02-08 07:03:16,038 DEBUG [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2 2023-02-08 07:03:16,038 DEBUG [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2 2023-02-08 07:03:16,038 INFO [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88b0ea7c06e199f4ac7f9f7b48dd93f3 columnFamilyName f2 2023-02-08 07:03:16,039 INFO [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] regionserver.HStore(310): Store=88b0ea7c06e199f4ac7f9f7b48dd93f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:16,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:16,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:16,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:16,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bd93a30a19626092a69882fcdac58e23; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68162641, jitterRate=0.0157025009393692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:16,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bd93a30a19626092a69882fcdac58e23: Running coprocessor pre-open hook at 1675839796025Writing region info on filesystem at 1675839796025Initializing all the Stores at 1675839796026 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839796026Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839796026Cleaning up temporary data from old regions at 1675839796033 (+7 ms)Cleaning up detritus from prior splits at 1675839796033Running coprocessor post-open hooks at 1675839796040 (+7 ms)Region opened successfully at 1675839796040 2023-02-08 07:03:16,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23., pid=29, masterSystemTime=1675839795962 2023-02-08 07:03:16,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:16,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:16,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:16,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:16,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:16,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4801b4e0c43dd2e3ec7a967389c4b183, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-08 07:03:16,043 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bd93a30a19626092a69882fcdac58e23, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:16,043 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675839796043"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839796043"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839796043"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839796043"}]},"ts":"1675839796043"} 2023-02-08 07:03:16,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:16,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:16,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:16,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:16,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 88b0ea7c06e199f4ac7f9f7b48dd93f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74562419, jitterRate=0.11106662452220917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:16,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 88b0ea7c06e199f4ac7f9f7b48dd93f3: Running coprocessor pre-open hook at 1675839796033Writing region info on filesystem at 1675839796033Initializing all the Stores at 1675839796034 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839796034Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839796034Cleaning up temporary data from old regions at 1675839796040 (+6 ms)Cleaning up detritus from prior splits at 1675839796041 (+1 ms)Running coprocessor post-open hooks at 1675839796045 (+4 ms)Region opened successfully at 1675839796045 2023-02-08 07:03:16,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3., pid=21, masterSystemTime=1675839795957 2023-02-08 07:03:16,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:16,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:16,047 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=88b0ea7c06e199f4ac7f9f7b48dd93f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,047 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839796047"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839796047"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839796047"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839796047"}]},"ts":"1675839796047"} 2023-02-08 07:03:16,049 INFO [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:16,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=11 2023-02-08 07:03:16,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=11, state=SUCCESS; OpenRegionProcedure bd93a30a19626092a69882fcdac58e23, server=jenkins-hbase4.apache.org,35101,1675839794238 in 236 msec 2023-02-08 07:03:16,050 DEBUG [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1 2023-02-08 07:03:16,051 DEBUG [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1 2023-02-08 07:03:16,051 INFO [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4801b4e0c43dd2e3ec7a967389c4b183 columnFamilyName f1 2023-02-08 07:03:16,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-08 07:03:16,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure 88b0ea7c06e199f4ac7f9f7b48dd93f3, server=jenkins-hbase4.apache.org,43331,1675839794266 in 244 msec 2023-02-08 07:03:16,051 INFO [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] regionserver.HStore(310): Store=4801b4e0c43dd2e3ec7a967389c4b183/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:16,051 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bd93a30a19626092a69882fcdac58e23, ASSIGN in 407 msec 2023-02-08 07:03:16,052 INFO [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:16,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=88b0ea7c06e199f4ac7f9f7b48dd93f3, ASSIGN in 408 msec 2023-02-08 07:03:16,053 DEBUG [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2 2023-02-08 07:03:16,053 DEBUG [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2 2023-02-08 07:03:16,053 INFO [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4801b4e0c43dd2e3ec7a967389c4b183 columnFamilyName f2 2023-02-08 07:03:16,053 INFO [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] regionserver.HStore(310): Store=4801b4e0c43dd2e3ec7a967389c4b183/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:16,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:16,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:16,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:16,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:16,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:16,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4801b4e0c43dd2e3ec7a967389c4b183; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74030602, jitterRate=0.10314193367958069}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:16,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4801b4e0c43dd2e3ec7a967389c4b183: Running coprocessor pre-open hook at 1675839796043Writing region info on filesystem at 1675839796043Initializing all the Stores at 1675839796048 (+5 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839796048Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839796048Cleaning up temporary data from old regions at 1675839796055 (+7 ms)Cleaning up detritus from prior splits at 1675839796055Running coprocessor post-open hooks at 1675839796061 (+6 ms)Region opened successfully at 1675839796061 2023-02-08 07:03:16,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183., pid=27, masterSystemTime=1675839795962 2023-02-08 07:03:16,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:16,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:16,063 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4801b4e0c43dd2e3ec7a967389c4b183, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,063 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839796063"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839796063"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839796063"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839796063"}]},"ts":"1675839796063"} 2023-02-08 07:03:16,066 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=15 2023-02-08 07:03:16,066 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=15, state=SUCCESS; OpenRegionProcedure 4801b4e0c43dd2e3ec7a967389c4b183, server=jenkins-hbase4.apache.org,35101,1675839794238 in 253 msec 2023-02-08 07:03:16,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-08 07:03:16,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4801b4e0c43dd2e3ec7a967389c4b183, ASSIGN in 423 msec 2023-02-08 07:03:16,068 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:03:16,068 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839796068"}]},"ts":"1675839796068"} 2023-02-08 07:03:16,069 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-08 07:03:16,071 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:03:16,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 564 msec 2023-02-08 07:03:16,115 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:16,115 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:16,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:16,116 INFO [Listener at localhost/35563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-08 07:03:16,117 DEBUG [Listener at localhost/35563] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-08 07:03:16,117 INFO [Listener at localhost/35563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:03:16,119 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-08 07:03:16,119 INFO [Listener at localhost/35563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:03:16,119 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-08 07:03:16,119 INFO [Listener at localhost/35563] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 07:03:16,152 DEBUG [hconnection-0x728f52ef-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:16,161 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45870, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:16,165 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43331] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:16,169 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35101] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:16,230 INFO [Listener at localhost/35563] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 07:03:16,230 INFO [Listener at localhost/35563] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 07:03:16,230 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:16,230 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:16,231 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-08 07:03:16,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675839796231 (current time:1675839796231). 2023-02-08 07:03:16,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 07:03:16,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] zookeeper.ReadOnlyZKClient(139): Connect 0x6b641551 to 127.0.0.1:60124 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:16,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42307c5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:16,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:16,240 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57322, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:16,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b641551 to 127.0.0.1:60124 2023-02-08 07:03:16,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:16,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 07:03:16,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-08 07:03:16,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-08 07:03:16,245 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-08 07:03:16,245 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675840396245 2023-02-08 07:03:16,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-08 07:03:16,246 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,247 DEBUG [Listener at localhost/35563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 07:03:16,247 DEBUG [Listener at localhost/35563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 07:03:16,248 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-08 07:03:16,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-08 07:03:16,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 5 msec 2023-02-08 07:03:16,250 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-08 07:03:16,250 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1675840396250 2023-02-08 07:03:16,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,264 INFO [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-08 07:03:16,264 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:16,265 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-08 07:03:16,265 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-08 07:03:16,265 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,265 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,268 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:16,268 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:16,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:16,268 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:16,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:16,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:16,268 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,268 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,269 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,269 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:03:16,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-08 07:03:16,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-08 07:03:16,269 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-08 07:03:16,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,269 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-08 07:03:16,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,276 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-08 07:03:16,276 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-08 07:03:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-08 07:03:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1675839794266' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-08 07:03:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-08 07:03:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-08 07:03:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-08 07:03:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35101,1675839794238' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-08 07:03:16,281 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,281 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:16,282 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,282 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,282 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:16,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:16,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:16,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:16,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:16,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43331,1675839794266' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-08 07:03:16,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12c88a5[Count = 1] remaining members to acquire global barrier 2023-02-08 07:03:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:16,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:16,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:16,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35101,1675839794238' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-08 07:03:16,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12c88a5[Count = 0] remaining members to acquire global barrier 2023-02-08 07:03:16,286 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-08 07:03:16,286 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,287 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,287 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,287 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-08 07:03:16,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,287 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-08 07:03:16,287 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,288 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,288 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:03:16,288 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:16,288 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. started... 2023-02-08 07:03:16,293 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 88b0ea7c06e199f4ac7f9f7b48dd93f3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:03:16,293 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:16,293 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. started... 2023-02-08 07:03:16,297 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4801b4e0c43dd2e3ec7a967389c4b183 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:03:16,297 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:16,297 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. started... 2023-02-08 07:03:16,297 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-08 07:03:16,297 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 07:03:16,297 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:16,297 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. started... 2023-02-08 07:03:16,301 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-08 07:03:16,301 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b90e49fec73de744aae2309c072367e0: 2023-02-08 07:03:16,301 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:16,301 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 07:03:16,301 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 941a8a477ea07d4f8905b62789d933da 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-08 07:03:16,301 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,301 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:16,301 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. started... 2023-02-08 07:03:16,301 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. started... 2023-02-08 07:03:16,303 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c344d75b5acd95336c6451dc11c34e23 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:03:16,302 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:16,303 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 07:03:16,303 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 07:03:16,304 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 52d462aa8eb46c1b3d5399c511d8a9bf 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:03:16,332 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. completed. 2023-02-08 07:03:16,332 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:16,332 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:16,332 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-08 07:03:16,332 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. started... 2023-02-08 07:03:16,337 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 26575cad1b966bdf12197b7268a90ea9 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:03:16,347 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/.tmp/f1/25dcf645855e404f9364b5f0203becf1 2023-02-08 07:03:16,347 DEBUG [Listener at localhost/35563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:16,347 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:16,347 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:16,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-08 07:03:16,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:03:16,349 DEBUG [Listener at localhost/35563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 07:03:16,363 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/.tmp/f1/afab8230e018466cafef78aac6ab7d64 2023-02-08 07:03:16,364 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/.tmp/f1/600fdaf2177f4f0aaaff495687a577c7 2023-02-08 07:03:16,378 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/.tmp/f1/edd6cee5329f429aa74973995599db89 2023-02-08 07:03:16,392 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/.tmp/f1/a1d5c12e4477491b9dd91522ea21fb9b 2023-02-08 07:03:16,393 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/.tmp/f1/0f5bc09287ec409d8a6b0f6d1d8a146a 2023-02-08 07:03:16,398 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/.tmp/f2/93b2e790518f4d5787473e4acf41298c 2023-02-08 07:03:16,411 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/.tmp/f1/25dcf645855e404f9364b5f0203becf1 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1/25dcf645855e404f9364b5f0203becf1 2023-02-08 07:03:16,415 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1/25dcf645855e404f9364b5f0203becf1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:16,416 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/.tmp/f2/93b2e790518f4d5787473e4acf41298c as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2/93b2e790518f4d5787473e4acf41298c 2023-02-08 07:03:16,428 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/.tmp/f2/ff5f28e6b32541818f20e6b5af1e5567 2023-02-08 07:03:16,430 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2/93b2e790518f4d5787473e4acf41298c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:16,431 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 88b0ea7c06e199f4ac7f9f7b48dd93f3 in 138ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:16,431 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-08 07:03:16,432 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 88b0ea7c06e199f4ac7f9f7b48dd93f3: 2023-02-08 07:03:16,432 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,432 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:16,432 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1/25dcf645855e404f9364b5f0203becf1] hfiles 2023-02-08 07:03:16,432 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1/25dcf645855e404f9364b5f0203becf1 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,432 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2/93b2e790518f4d5787473e4acf41298c] hfiles 2023-02-08 07:03:16,432 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2/93b2e790518f4d5787473e4acf41298c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,440 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/.tmp/f2/ec3a2e7fa5e34f5db5bdd2044ddbc2f3 2023-02-08 07:03:16,443 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/.tmp/f1/600fdaf2177f4f0aaaff495687a577c7 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1/600fdaf2177f4f0aaaff495687a577c7 2023-02-08 07:03:16,443 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/.tmp/f2/2e40834bfc014aa88fe1b694b2199d30 2023-02-08 07:03:16,447 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/.tmp/f2/dd0db0e2f85c44888df8c6f948eac825 2023-02-08 07:03:16,448 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1/600fdaf2177f4f0aaaff495687a577c7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:16,449 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/.tmp/f1/edd6cee5329f429aa74973995599db89 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1/edd6cee5329f429aa74973995599db89 2023-02-08 07:03:16,450 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/.tmp/f2/ff5f28e6b32541818f20e6b5af1e5567 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2/ff5f28e6b32541818f20e6b5af1e5567 2023-02-08 07:03:16,451 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. completed. 2023-02-08 07:03:16,451 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:16,451 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:16,451 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-08 07:03:16,451 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. started... 2023-02-08 07:03:16,451 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/.tmp/f1/afab8230e018466cafef78aac6ab7d64 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1/afab8230e018466cafef78aac6ab7d64 2023-02-08 07:03:16,453 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 84049d23f1836ed1456960a4993876e6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 07:03:16,456 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/.tmp/f2/61c4b5ba3ebd4703bdb70109d1afc09e 2023-02-08 07:03:16,457 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/.tmp/f1/a1d5c12e4477491b9dd91522ea21fb9b as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1/a1d5c12e4477491b9dd91522ea21fb9b 2023-02-08 07:03:16,458 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1/edd6cee5329f429aa74973995599db89, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:16,459 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/.tmp/f2/ec3a2e7fa5e34f5db5bdd2044ddbc2f3 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2/ec3a2e7fa5e34f5db5bdd2044ddbc2f3 2023-02-08 07:03:16,460 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2/ff5f28e6b32541818f20e6b5af1e5567, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:16,461 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4801b4e0c43dd2e3ec7a967389c4b183 in 164ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:16,465 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4801b4e0c43dd2e3ec7a967389c4b183: 2023-02-08 07:03:16,465 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,466 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1/a1d5c12e4477491b9dd91522ea21fb9b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:16,467 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/.tmp/f2/dd0db0e2f85c44888df8c6f948eac825 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2/dd0db0e2f85c44888df8c6f948eac825 2023-02-08 07:03:16,468 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:16,468 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1/afab8230e018466cafef78aac6ab7d64, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 07:03:16,468 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1/600fdaf2177f4f0aaaff495687a577c7] hfiles 2023-02-08 07:03:16,468 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1/600fdaf2177f4f0aaaff495687a577c7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,468 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2/ff5f28e6b32541818f20e6b5af1e5567] hfiles 2023-02-08 07:03:16,468 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2/ff5f28e6b32541818f20e6b5af1e5567 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,469 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/.tmp/f2/2e40834bfc014aa88fe1b694b2199d30 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2/2e40834bfc014aa88fe1b694b2199d30 2023-02-08 07:03:16,470 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2/ec3a2e7fa5e34f5db5bdd2044ddbc2f3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:16,471 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/.tmp/f1/0f5bc09287ec409d8a6b0f6d1d8a146a as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1/0f5bc09287ec409d8a6b0f6d1d8a146a 2023-02-08 07:03:16,471 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 52d462aa8eb46c1b3d5399c511d8a9bf in 167ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:16,471 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 52d462aa8eb46c1b3d5399c511d8a9bf: 2023-02-08 07:03:16,472 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,472 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:16,472 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1/edd6cee5329f429aa74973995599db89] hfiles 2023-02-08 07:03:16,472 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1/edd6cee5329f429aa74973995599db89 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,472 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2/ec3a2e7fa5e34f5db5bdd2044ddbc2f3] hfiles 2023-02-08 07:03:16,472 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2/ec3a2e7fa5e34f5db5bdd2044ddbc2f3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,478 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2/2e40834bfc014aa88fe1b694b2199d30, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 07:03:16,478 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2/dd0db0e2f85c44888df8c6f948eac825, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:16,479 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c344d75b5acd95336c6451dc11c34e23 in 176ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:16,479 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 941a8a477ea07d4f8905b62789d933da in 178ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:16,479 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c344d75b5acd95336c6451dc11c34e23: 2023-02-08 07:03:16,479 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 941a8a477ea07d4f8905b62789d933da: 2023-02-08 07:03:16,479 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,479 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:16,479 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,479 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1/a1d5c12e4477491b9dd91522ea21fb9b] hfiles 2023-02-08 07:03:16,479 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:16,479 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1/a1d5c12e4477491b9dd91522ea21fb9b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,479 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1/afab8230e018466cafef78aac6ab7d64] hfiles 2023-02-08 07:03:16,479 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2/dd0db0e2f85c44888df8c6f948eac825] hfiles 2023-02-08 07:03:16,479 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1/afab8230e018466cafef78aac6ab7d64 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,479 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2/dd0db0e2f85c44888df8c6f948eac825 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,480 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2/2e40834bfc014aa88fe1b694b2199d30] hfiles 2023-02-08 07:03:16,480 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2/2e40834bfc014aa88fe1b694b2199d30 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,486 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1/0f5bc09287ec409d8a6b0f6d1d8a146a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:16,486 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/.tmp/f2/61c4b5ba3ebd4703bdb70109d1afc09e as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2/61c4b5ba3ebd4703bdb70109d1afc09e 2023-02-08 07:03:16,504 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. completed. 2023-02-08 07:03:16,504 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:16,504 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/.tmp/f1/0ab743e981b849219aacf8e1005d5b6e 2023-02-08 07:03:16,504 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-08 07:03:16,504 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:16,505 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. started... 2023-02-08 07:03:16,513 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bd93a30a19626092a69882fcdac58e23: 2023-02-08 07:03:16,513 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,513 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:16,513 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 07:03:16,513 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 07:03:16,515 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2/61c4b5ba3ebd4703bdb70109d1afc09e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:16,516 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 26575cad1b966bdf12197b7268a90ea9 in 179ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:16,516 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 26575cad1b966bdf12197b7268a90ea9: 2023-02-08 07:03:16,516 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,516 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:16,516 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1/0f5bc09287ec409d8a6b0f6d1d8a146a] hfiles 2023-02-08 07:03:16,516 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1/0f5bc09287ec409d8a6b0f6d1d8a146a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,517 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2/61c4b5ba3ebd4703bdb70109d1afc09e] hfiles 2023-02-08 07:03:16,517 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2/61c4b5ba3ebd4703bdb70109d1afc09e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,520 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. completed. 2023-02-08 07:03:16,520 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:16,520 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. completed. 2023-02-08 07:03:16,520 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-08 07:03:16,520 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:16,520 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:16,520 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. started... 2023-02-08 07:03:16,521 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HRegion(2744): Flushing ef8f74b75cb8a75fb50619be90b2fdca 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-08 07:03:16,522 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. completed. 2023-02-08 07:03:16,522 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:16,522 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-08 07:03:16,522 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-08 07:03:16,540 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. completed. 2023-02-08 07:03:16,540 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:16,540 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-08 07:03:16,544 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. completed. 2023-02-08 07:03:16,544 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:16,544 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-08 07:03:16,546 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/.tmp/f1/9da0d75c48be43d48063b785ef4e2fd4 2023-02-08 07:03:16,549 DEBUG [Listener at localhost/35563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:16,550 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:16,550 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:16,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-08 07:03:16,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:03:16,551 DEBUG [Listener at localhost/35563] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-08 07:03:16,560 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/.tmp/f2/4c8af141eb03460786fd37b2ca1163ca 2023-02-08 07:03:16,566 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/.tmp/f1/9da0d75c48be43d48063b785ef4e2fd4 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1/9da0d75c48be43d48063b785ef4e2fd4 2023-02-08 07:03:16,571 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1/9da0d75c48be43d48063b785ef4e2fd4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 07:03:16,572 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/.tmp/f2/4c8af141eb03460786fd37b2ca1163ca as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2/4c8af141eb03460786fd37b2ca1163ca 2023-02-08 07:03:16,576 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2/4c8af141eb03460786fd37b2ca1163ca, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 07:03:16,577 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ef8f74b75cb8a75fb50619be90b2fdca in 56ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:16,577 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ef8f74b75cb8a75fb50619be90b2fdca: 2023-02-08 07:03:16,577 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,577 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:16,577 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1/9da0d75c48be43d48063b785ef4e2fd4] hfiles 2023-02-08 07:03:16,577 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1/9da0d75c48be43d48063b785ef4e2fd4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,577 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2/4c8af141eb03460786fd37b2ca1163ca] hfiles 2023-02-08 07:03:16,577 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2/4c8af141eb03460786fd37b2ca1163ca for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,590 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. completed. 2023-02-08 07:03:16,590 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:16,590 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-08 07:03:16,590 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-08 07:03:16,590 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,590 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-08 07:03:16,590 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35101,1675839794238' in zk 2023-02-08 07:03:16,593 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-08 07:03:16,593 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:16,593 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,593 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-08 07:03:16,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:16,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:16,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:16,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:16,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:16,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35101,1675839794238': 2023-02-08 07:03:16,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35101,1675839794238' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-08 07:03:16,852 DEBUG [Listener at localhost/35563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:16,852 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:16,852 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:16,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-08 07:03:16,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:03:16,853 DEBUG [Listener at localhost/35563] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-08 07:03:16,938 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/.tmp/f2/d68456cb9765442297adf30ad39db6fa 2023-02-08 07:03:16,943 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/.tmp/f1/0ab743e981b849219aacf8e1005d5b6e as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1/0ab743e981b849219aacf8e1005d5b6e 2023-02-08 07:03:16,947 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1/0ab743e981b849219aacf8e1005d5b6e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:16,948 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/.tmp/f2/d68456cb9765442297adf30ad39db6fa as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2/d68456cb9765442297adf30ad39db6fa 2023-02-08 07:03:16,952 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2/d68456cb9765442297adf30ad39db6fa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 07:03:16,953 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 84049d23f1836ed1456960a4993876e6 in 501ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:16,953 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 84049d23f1836ed1456960a4993876e6: 2023-02-08 07:03:16,953 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,953 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:16,953 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1/0ab743e981b849219aacf8e1005d5b6e] hfiles 2023-02-08 07:03:16,953 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1/0ab743e981b849219aacf8e1005d5b6e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,953 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2/d68456cb9765442297adf30ad39db6fa] hfiles 2023-02-08 07:03:16,953 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2/d68456cb9765442297adf30ad39db6fa for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,958 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. completed. 2023-02-08 07:03:16,958 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:16,958 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-08 07:03:16,959 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-08 07:03:16,959 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,959 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-08 07:03:16,959 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43331,1675839794266' in zk 2023-02-08 07:03:16,960 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-08 07:03:16,960 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,960 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:16,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:16,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:16,960 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-08 07:03:16,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:16,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:16,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:16,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43331,1675839794266': 2023-02-08 07:03:16,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43331,1675839794266' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-08 07:03:16,964 INFO [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-08 07:03:16,964 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:03:16,964 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:03:16,964 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,964 INFO [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 07:03:16,965 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,965 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,965 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:16,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:16,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,965 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:16,965 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:16,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:16,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:16,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:16,966 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:16,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:16,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,966 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:16,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,967 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:16,968 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,977 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,977 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:16,977 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:16,977 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:16,977 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,977 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:16,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:16,977 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:16,977 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:16,977 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,978 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,978 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:16,978 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,978 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:16,978 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,978 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:16,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:16,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:16,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,039 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-08 07:03:17,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,040 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1675839796246Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1675839796977 (+731 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1675839796977Writing data manifest for testWithMockedMapReduceMultiRegion at 1675839796986 (+9 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1675839797001 (+15 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1675839797039 (+38 ms) 2023-02-08 07:03:17,041 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-08 07:03:17,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 794 msec 2023-02-08 07:03:17,353 DEBUG [Listener at localhost/35563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:17,354 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:17,354 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:17,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-08 07:03:17,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 07:03:17,355 INFO [Listener at localhost/35563] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 07:03:17,355 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:17,355 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:17,359 INFO [Listener at localhost/35563] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 07:03:17,365 INFO [Listener at localhost/35563] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 07:03:17,390 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43331] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:17,391 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35101] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:17,438 INFO [Listener at localhost/35563] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 07:03:17,442 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:17,442 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:17,444 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 07:03:17,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,446 INFO [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-08 07:03:17,446 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:17,447 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-08 07:03:17,447 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-08 07:03:17,447 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,447 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,449 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,449 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:17,449 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:17,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:17,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:17,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:17,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:17,449 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,449 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,449 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,450 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:03:17,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:03:17,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:03:17,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,450 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,450 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-08 07:03:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-08 07:03:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-08 07:03:17,452 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-08 07:03:17,452 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:17,452 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. started... 2023-02-08 07:03:17,452 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4801b4e0c43dd2e3ec7a967389c4b183 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:03:17,453 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:17,453 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. started... 2023-02-08 07:03:17,453 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:17,453 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. started... 2023-02-08 07:03:17,453 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:17,453 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. started... 2023-02-08 07:03:17,453 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 88b0ea7c06e199f4ac7f9f7b48dd93f3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:03:17,453 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b90e49fec73de744aae2309c072367e0: 2023-02-08 07:03:17,453 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 52d462aa8eb46c1b3d5399c511d8a9bf 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:03:17,453 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-08 07:03:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 07:03:17,456 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:17,456 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. started... 2023-02-08 07:03:17,456 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 941a8a477ea07d4f8905b62789d933da 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-08 07:03:17,462 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-08 07:03:17,462 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 07:03:17,462 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:17,463 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-08 07:03:17,463 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. started... 2023-02-08 07:03:17,463 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:17,463 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c344d75b5acd95336c6451dc11c34e23 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:03:17,463 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. started... 2023-02-08 07:03:17,463 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 26575cad1b966bdf12197b7268a90ea9 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:03:17,497 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/.tmp/f1/6ca2a389ca6743d3a5021d2f2027a9c9 2023-02-08 07:03:17,506 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/.tmp/f1/bed4c782dfea4516abcec048b63e8f09 2023-02-08 07:03:17,506 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/.tmp/f1/9c3af00c9b0b4263862a63d9f73ffd04 2023-02-08 07:03:17,506 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/.tmp/f1/d493615b5e3c4f68abb1d4c21ee203f8 2023-02-08 07:03:17,570 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/.tmp/f1/567d9ed4598d42e6911474e63c76f074 2023-02-08 07:03:17,571 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/.tmp/f1/0ff794f3d4a0495d857d70646c2a1484 2023-02-08 07:03:17,571 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/.tmp/f2/f2d5ff6e92a9444bb3940fc5ae3aeb27 2023-02-08 07:03:17,577 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/.tmp/f1/6ca2a389ca6743d3a5021d2f2027a9c9 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1/6ca2a389ca6743d3a5021d2f2027a9c9 2023-02-08 07:03:17,583 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1/6ca2a389ca6743d3a5021d2f2027a9c9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:17,584 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/.tmp/f2/f2d5ff6e92a9444bb3940fc5ae3aeb27 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2/f2d5ff6e92a9444bb3940fc5ae3aeb27 2023-02-08 07:03:17,588 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2/f2d5ff6e92a9444bb3940fc5ae3aeb27, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:17,589 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 52d462aa8eb46c1b3d5399c511d8a9bf in 136ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:17,589 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 52d462aa8eb46c1b3d5399c511d8a9bf: 2023-02-08 07:03:17,589 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:17,595 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:17,595 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-08 07:03:17,595 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. started... 2023-02-08 07:03:17,595 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bd93a30a19626092a69882fcdac58e23: 2023-02-08 07:03:17,595 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:17,595 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:17,595 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-08 07:03:17,595 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. started... 2023-02-08 07:03:17,595 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ef8f74b75cb8a75fb50619be90b2fdca 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-08 07:03:17,604 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/.tmp/f2/a8b57cda2a4c4da49cffaf0ff0abf7e6 2023-02-08 07:03:17,621 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/.tmp/f1/d493615b5e3c4f68abb1d4c21ee203f8 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1/d493615b5e3c4f68abb1d4c21ee203f8 2023-02-08 07:03:17,624 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/.tmp/f2/3eff4b5ee34e4c49b255fcb826ec3b02 2023-02-08 07:03:17,627 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1/d493615b5e3c4f68abb1d4c21ee203f8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:17,628 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/.tmp/f2/a8b57cda2a4c4da49cffaf0ff0abf7e6 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2/a8b57cda2a4c4da49cffaf0ff0abf7e6 2023-02-08 07:03:17,628 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/.tmp/f2/353d04a17e934a1ba70c9d9ecbca4286 2023-02-08 07:03:17,628 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/.tmp/f2/3336cfeb678845fab1c63c7a0ec8a667 2023-02-08 07:03:17,634 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/.tmp/f1/567d9ed4598d42e6911474e63c76f074 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1/567d9ed4598d42e6911474e63c76f074 2023-02-08 07:03:17,636 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/.tmp/f2/aec4df1341dc4cd0962f9020d7cf5f27 2023-02-08 07:03:17,638 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2/a8b57cda2a4c4da49cffaf0ff0abf7e6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:17,639 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4801b4e0c43dd2e3ec7a967389c4b183 in 187ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:17,639 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4801b4e0c43dd2e3ec7a967389c4b183: 2023-02-08 07:03:17,639 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:17,639 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/.tmp/f1/0ff794f3d4a0495d857d70646c2a1484 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1/0ff794f3d4a0495d857d70646c2a1484 2023-02-08 07:03:17,639 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-08 07:03:17,640 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1/567d9ed4598d42e6911474e63c76f074, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:17,640 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/.tmp/f1/9ab5cc36b3f5473ab62f010beab2d13a 2023-02-08 07:03:17,640 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/.tmp/f1/9c3af00c9b0b4263862a63d9f73ffd04 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1/9c3af00c9b0b4263862a63d9f73ffd04 2023-02-08 07:03:17,641 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/.tmp/f2/3336cfeb678845fab1c63c7a0ec8a667 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2/3336cfeb678845fab1c63c7a0ec8a667 2023-02-08 07:03:17,641 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/.tmp/f1/bed4c782dfea4516abcec048b63e8f09 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1/bed4c782dfea4516abcec048b63e8f09 2023-02-08 07:03:17,646 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1/bed4c782dfea4516abcec048b63e8f09, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 07:03:17,646 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/.tmp/f2/aec4df1341dc4cd0962f9020d7cf5f27 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2/aec4df1341dc4cd0962f9020d7cf5f27 2023-02-08 07:03:17,652 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1/0ff794f3d4a0495d857d70646c2a1484, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:17,656 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/.tmp/f2/3eff4b5ee34e4c49b255fcb826ec3b02 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2/3eff4b5ee34e4c49b255fcb826ec3b02 2023-02-08 07:03:17,657 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1/9c3af00c9b0b4263862a63d9f73ffd04, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:17,657 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2/3336cfeb678845fab1c63c7a0ec8a667, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:17,658 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 88b0ea7c06e199f4ac7f9f7b48dd93f3 in 205ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:17,658 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 88b0ea7c06e199f4ac7f9f7b48dd93f3: 2023-02-08 07:03:17,658 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:17,658 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:17,658 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. started... 2023-02-08 07:03:17,658 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-08 07:03:17,658 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 84049d23f1836ed1456960a4993876e6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 07:03:17,658 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/.tmp/f2/353d04a17e934a1ba70c9d9ecbca4286 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2/353d04a17e934a1ba70c9d9ecbca4286 2023-02-08 07:03:17,661 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2/aec4df1341dc4cd0962f9020d7cf5f27, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 07:03:17,661 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 941a8a477ea07d4f8905b62789d933da in 205ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:17,661 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 941a8a477ea07d4f8905b62789d933da: 2023-02-08 07:03:17,661 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:17,661 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-08 07:03:17,662 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2/3eff4b5ee34e4c49b255fcb826ec3b02, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:17,663 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c344d75b5acd95336c6451dc11c34e23 in 200ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:17,663 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c344d75b5acd95336c6451dc11c34e23: 2023-02-08 07:03:17,663 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:17,663 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-08 07:03:17,666 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2/353d04a17e934a1ba70c9d9ecbca4286, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:17,667 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 26575cad1b966bdf12197b7268a90ea9 in 204ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:17,667 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 26575cad1b966bdf12197b7268a90ea9: 2023-02-08 07:03:17,667 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:17,667 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-08 07:03:17,669 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/.tmp/f2/4e803a113af54789bef0e875261af07e 2023-02-08 07:03:17,674 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/.tmp/f1/9ab5cc36b3f5473ab62f010beab2d13a as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1/9ab5cc36b3f5473ab62f010beab2d13a 2023-02-08 07:03:17,678 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1/9ab5cc36b3f5473ab62f010beab2d13a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 07:03:17,679 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/.tmp/f2/4e803a113af54789bef0e875261af07e as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2/4e803a113af54789bef0e875261af07e 2023-02-08 07:03:17,684 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2/4e803a113af54789bef0e875261af07e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 07:03:17,685 INFO [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ef8f74b75cb8a75fb50619be90b2fdca in 90ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:17,685 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ef8f74b75cb8a75fb50619be90b2fdca: 2023-02-08 07:03:17,685 DEBUG [rs(jenkins-hbase4.apache.org,35101,1675839794238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-08 07:03:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-08 07:03:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,686 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-08 07:03:17,686 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35101,1675839794238' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-08 07:03:17,688 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,688 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:17,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:17,689 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,689 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:17,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:17,689 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/.tmp/f1/6e4fe324773d4906b61cb0ff036b6f80 2023-02-08 07:03:17,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:17,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35101,1675839794238' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-08 07:03:17,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5131c58[Count = 1] remaining members to acquire global barrier 2023-02-08 07:03:17,706 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/.tmp/f2/db93814724ce4512a893bcaf4bc13c84 2023-02-08 07:03:17,710 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/.tmp/f1/6e4fe324773d4906b61cb0ff036b6f80 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1/6e4fe324773d4906b61cb0ff036b6f80 2023-02-08 07:03:17,714 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1/6e4fe324773d4906b61cb0ff036b6f80, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:17,715 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/.tmp/f2/db93814724ce4512a893bcaf4bc13c84 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2/db93814724ce4512a893bcaf4bc13c84 2023-02-08 07:03:17,719 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2/db93814724ce4512a893bcaf4bc13c84, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 07:03:17,720 INFO [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 84049d23f1836ed1456960a4993876e6 in 62ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:17,720 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 84049d23f1836ed1456960a4993876e6: 2023-02-08 07:03:17,720 DEBUG [rs(jenkins-hbase4.apache.org,43331,1675839794266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:17,720 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-08 07:03:17,720 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-08 07:03:17,720 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,720 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-08 07:03:17,720 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43331,1675839794266' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-08 07:03:17,721 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,721 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:17,722 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,722 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:17,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:17,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:17,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:17,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43331,1675839794266' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-08 07:03:17,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5131c58[Count = 0] remaining members to acquire global barrier 2023-02-08 07:03:17,723 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-08 07:03:17,723 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,725 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,725 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,725 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-08 07:03:17,725 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-08 07:03:17,725 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-08 07:03:17,725 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43331,1675839794266' in zk 2023-02-08 07:03:17,725 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,725 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-08 07:03:17,726 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35101,1675839794238' in zk 2023-02-08 07:03:17,726 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,726 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:03:17,727 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-08 07:03:17,727 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,727 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:17,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:17,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:17,727 DEBUG [member: 'jenkins-hbase4.apache.org,43331,1675839794266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-08 07:03:17,728 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,728 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-08 07:03:17,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:17,728 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:17,728 DEBUG [member: 'jenkins-hbase4.apache.org,35101,1675839794238' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-08 07:03:17,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:17,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:17,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43331,1675839794266': 2023-02-08 07:03:17,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43331,1675839794266' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-08 07:03:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:17,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:17,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:17,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35101,1675839794238': 2023-02-08 07:03:17,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35101,1675839794238' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-08 07:03:17,733 INFO [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-08 07:03:17,733 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:03:17,733 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:03:17,733 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,733 INFO [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 07:03:17,734 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,734 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:17,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:17,734 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:17,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,734 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,735 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:17,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:17,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:17,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:17,735 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:17,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:17,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,736 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:17,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,737 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:17,737 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,741 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:17,741 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:17,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:17,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:17,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:17,741 DEBUG [(jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:17,741 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:17,741 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:17,741 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,741 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-08 07:03:17,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 07:03:17,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:17,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:17,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:17,741 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,742 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:17,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:17,742 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,742 DEBUG [Listener at localhost/35563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-08 07:03:17,742 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:17,742 DEBUG [Listener at localhost/35563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 07:03:17,742 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,742 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:17,742 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,742 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,842 DEBUG [Listener at localhost/35563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 07:03:17,842 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:17,843 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:17,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 07:03:17,848 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675839796231 type: FLUSH version: 2 ttl: 0 2023-02-08 07:03:17,849 DEBUG [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,849 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(239): region to add: 4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:17,849 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(239): region to add: 88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:17,849 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(239): region to add: 52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:17,849 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(239): region to add: b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:17,849 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(239): region to add: bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(239): region to add: 941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(239): region to add: c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(239): region to add: 26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(239): region to add: 84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(239): region to add: ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(585): clone region=4801b4e0c43dd2e3ec7a967389c4b183 as 4801b4e0c43dd2e3ec7a967389c4b183 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(585): clone region=88b0ea7c06e199f4ac7f9f7b48dd93f3 as 88b0ea7c06e199f4ac7f9f7b48dd93f3 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(585): clone region=52d462aa8eb46c1b3d5399c511d8a9bf as 52d462aa8eb46c1b3d5399c511d8a9bf in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(585): clone region=b90e49fec73de744aae2309c072367e0 as b90e49fec73de744aae2309c072367e0 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(585): clone region=bd93a30a19626092a69882fcdac58e23 as bd93a30a19626092a69882fcdac58e23 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(585): clone region=941a8a477ea07d4f8905b62789d933da as 941a8a477ea07d4f8905b62789d933da in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(585): clone region=c344d75b5acd95336c6451dc11c34e23 as c344d75b5acd95336c6451dc11c34e23 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,850 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(585): clone region=26575cad1b966bdf12197b7268a90ea9 as 26575cad1b966bdf12197b7268a90ea9 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,851 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(585): clone region=84049d23f1836ed1456960a4993876e6 as 84049d23f1836ed1456960a4993876e6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,851 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(585): clone region=ef8f74b75cb8a75fb50619be90b2fdca as ef8f74b75cb8a75fb50619be90b2fdca in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,852 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 52d462aa8eb46c1b3d5399c511d8a9bf, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92 2023-02-08 07:03:17,852 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 88b0ea7c06e199f4ac7f9f7b48dd93f3, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92 2023-02-08 07:03:17,852 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => b90e49fec73de744aae2309c072367e0, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92 2023-02-08 07:03:17,852 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 26575cad1b966bdf12197b7268a90ea9, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92 2023-02-08 07:03:17,853 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => c344d75b5acd95336c6451dc11c34e23, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92 2023-02-08 07:03:17,853 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 941a8a477ea07d4f8905b62789d933da, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92 2023-02-08 07:03:17,853 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => bd93a30a19626092a69882fcdac58e23, NAME => 'testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92 2023-02-08 07:03:17,853 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4801b4e0c43dd2e3ec7a967389c4b183, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92 2023-02-08 07:03:17,883 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:17,883 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink edd6cee5329f429aa74973995599db89 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,891 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ec3a2e7fa5e34f5db5bdd2044ddbc2f3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,902 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:17,902 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 600fdaf2177f4f0aaaff495687a577c7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,905 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 52d462aa8eb46c1b3d5399c511d8a9bf, disabling compactions & flushes 2023-02-08 07:03:17,905 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:17,905 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:17,905 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. after waiting 0 ms 2023-02-08 07:03:17,905 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:17,905 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:17,905 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 52d462aa8eb46c1b3d5399c511d8a9bf: Waiting for close lock at 1675839797905Disabling compacts and flushes for region at 1675839797905Disabling writes for close at 1675839797905Writing region close event to WAL at 1675839797905Closed at 1675839797905 2023-02-08 07:03:17,905 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:17,906 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 84049d23f1836ed1456960a4993876e6, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92 2023-02-08 07:03:17,906 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing bd93a30a19626092a69882fcdac58e23, disabling compactions & flushes 2023-02-08 07:03:17,906 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:17,906 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:17,906 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. after waiting 0 ms 2023-02-08 07:03:17,906 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:17,906 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:17,906 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for bd93a30a19626092a69882fcdac58e23: Waiting for close lock at 1675839797906Disabling compacts and flushes for region at 1675839797906Disabling writes for close at 1675839797906Writing region close event to WAL at 1675839797906Closed at 1675839797906 2023-02-08 07:03:17,907 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ef8f74b75cb8a75fb50619be90b2fdca, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92 2023-02-08 07:03:17,907 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:17,907 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0f5bc09287ec409d8a6b0f6d1d8a146a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,907 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:17,907 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink afab8230e018466cafef78aac6ab7d64 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,914 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:17,914 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a1d5c12e4477491b9dd91522ea21fb9b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,914 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:17,914 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing b90e49fec73de744aae2309c072367e0, disabling compactions & flushes 2023-02-08 07:03:17,914 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:17,914 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:17,914 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. after waiting 0 ms 2023-02-08 07:03:17,914 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:17,914 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:17,914 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for b90e49fec73de744aae2309c072367e0: Waiting for close lock at 1675839797914Disabling compacts and flushes for region at 1675839797914Disabling writes for close at 1675839797914Writing region close event to WAL at 1675839797914Closed at 1675839797914 2023-02-08 07:03:17,919 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:17,919 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 25dcf645855e404f9364b5f0203becf1 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,919 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 61c4b5ba3ebd4703bdb70109d1afc09e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,919 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ff5f28e6b32541818f20e6b5af1e5567 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,921 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2e40834bfc014aa88fe1b694b2199d30 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,931 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 26575cad1b966bdf12197b7268a90ea9, disabling compactions & flushes 2023-02-08 07:03:17,931 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:17,931 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 93b2e790518f4d5787473e4acf41298c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,931 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dd0db0e2f85c44888df8c6f948eac825 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,931 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:17,931 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. after waiting 0 ms 2023-02-08 07:03:17,931 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:17,931 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:17,931 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 26575cad1b966bdf12197b7268a90ea9: Waiting for close lock at 1675839797931Disabling compacts and flushes for region at 1675839797931Disabling writes for close at 1675839797931Writing region close event to WAL at 1675839797931Closed at 1675839797931 2023-02-08 07:03:17,932 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4801b4e0c43dd2e3ec7a967389c4b183, disabling compactions & flushes 2023-02-08 07:03:17,932 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 941a8a477ea07d4f8905b62789d933da, disabling compactions & flushes 2023-02-08 07:03:17,932 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:17,932 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:17,932 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:17,932 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. after waiting 0 ms 2023-02-08 07:03:17,932 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:17,932 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:17,932 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:17,932 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. after waiting 0 ms 2023-02-08 07:03:17,933 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:17,933 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 941a8a477ea07d4f8905b62789d933da: Waiting for close lock at 1675839797932Disabling compacts and flushes for region at 1675839797932Disabling writes for close at 1675839797932Writing region close event to WAL at 1675839797932Closed at 1675839797932 2023-02-08 07:03:17,933 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:17,933 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4801b4e0c43dd2e3ec7a967389c4b183: Waiting for close lock at 1675839797932Disabling compacts and flushes for region at 1675839797932Disabling writes for close at 1675839797933 (+1 ms)Writing region close event to WAL at 1675839797933Closed at 1675839797933 2023-02-08 07:03:17,933 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 88b0ea7c06e199f4ac7f9f7b48dd93f3, disabling compactions & flushes 2023-02-08 07:03:17,933 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:17,934 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:17,934 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. after waiting 0 ms 2023-02-08 07:03:17,934 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:17,934 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:17,934 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 88b0ea7c06e199f4ac7f9f7b48dd93f3: Waiting for close lock at 1675839797933Disabling compacts and flushes for region at 1675839797933Disabling writes for close at 1675839797934 (+1 ms)Writing region close event to WAL at 1675839797934Closed at 1675839797934 2023-02-08 07:03:17,934 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing c344d75b5acd95336c6451dc11c34e23, disabling compactions & flushes 2023-02-08 07:03:17,934 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:17,934 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:17,934 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. after waiting 0 ms 2023-02-08 07:03:17,934 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:17,934 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:17,934 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for c344d75b5acd95336c6451dc11c34e23: Waiting for close lock at 1675839797934Disabling compacts and flushes for region at 1675839797934Disabling writes for close at 1675839797934Writing region close event to WAL at 1675839797934Closed at 1675839797934 2023-02-08 07:03:17,935 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:17,935 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0ab743e981b849219aacf8e1005d5b6e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,938 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d68456cb9765442297adf30ad39db6fa from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:17,940 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 84049d23f1836ed1456960a4993876e6, disabling compactions & flushes 2023-02-08 07:03:17,940 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:17,940 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:17,940 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. after waiting 0 ms 2023-02-08 07:03:17,940 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:17,940 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:17,940 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 84049d23f1836ed1456960a4993876e6: Waiting for close lock at 1675839797940Disabling compacts and flushes for region at 1675839797940Disabling writes for close at 1675839797940Writing region close event to WAL at 1675839797940Closed at 1675839797940 2023-02-08 07:03:18,338 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:18,338 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9da0d75c48be43d48063b785ef4e2fd4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:18,340 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4c8af141eb03460786fd37b2ca1163ca from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:18,342 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ef8f74b75cb8a75fb50619be90b2fdca, disabling compactions & flushes 2023-02-08 07:03:18,342 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:18,342 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:18,342 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. after waiting 0 ms 2023-02-08 07:03:18,342 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:18,342 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:18,342 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ef8f74b75cb8a75fb50619be90b2fdca: Waiting for close lock at 1675839798342Disabling compacts and flushes for region at 1675839798342Disabling writes for close at 1675839798342Writing region close event to WAL at 1675839798342Closed at 1675839798342 2023-02-08 07:03:18,343 INFO [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675839796231 type: FLUSH version: 2 ttl: 0 2023-02-08 07:03:18,343 DEBUG [Listener at localhost/35563] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92 2023-02-08 07:03:18,343 DEBUG [Listener at localhost/35563] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92 2023-02-08 07:03:18,343 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-data/ 2023-02-08 07:03:18,344 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |----default/ 2023-02-08 07:03:18,344 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-08 07:03:18,345 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |----------26575cad1b966bdf12197b7268a90ea9/ 2023-02-08 07:03:18,345 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:18,345 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:18,345 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=26575cad1b966bdf12197b7268a90ea9-0f5bc09287ec409d8a6b0f6d1d8a146a 2023-02-08 07:03:18,345 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:18,346 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=26575cad1b966bdf12197b7268a90ea9-61c4b5ba3ebd4703bdb70109d1afc09e 2023-02-08 07:03:18,346 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |----------4801b4e0c43dd2e3ec7a967389c4b183/ 2023-02-08 07:03:18,346 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:18,346 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:18,347 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4801b4e0c43dd2e3ec7a967389c4b183-600fdaf2177f4f0aaaff495687a577c7 2023-02-08 07:03:18,347 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:18,347 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4801b4e0c43dd2e3ec7a967389c4b183-ff5f28e6b32541818f20e6b5af1e5567 2023-02-08 07:03:18,347 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |----------52d462aa8eb46c1b3d5399c511d8a9bf/ 2023-02-08 07:03:18,347 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:18,347 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:18,348 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=52d462aa8eb46c1b3d5399c511d8a9bf-edd6cee5329f429aa74973995599db89 2023-02-08 07:03:18,348 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:18,348 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=52d462aa8eb46c1b3d5399c511d8a9bf-ec3a2e7fa5e34f5db5bdd2044ddbc2f3 2023-02-08 07:03:18,348 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |----------84049d23f1836ed1456960a4993876e6/ 2023-02-08 07:03:18,349 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:18,349 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:18,349 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=84049d23f1836ed1456960a4993876e6-0ab743e981b849219aacf8e1005d5b6e 2023-02-08 07:03:18,349 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:18,349 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=84049d23f1836ed1456960a4993876e6-d68456cb9765442297adf30ad39db6fa 2023-02-08 07:03:18,349 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |----------88b0ea7c06e199f4ac7f9f7b48dd93f3/ 2023-02-08 07:03:18,350 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:18,350 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:18,350 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=88b0ea7c06e199f4ac7f9f7b48dd93f3-25dcf645855e404f9364b5f0203becf1 2023-02-08 07:03:18,350 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:18,350 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=88b0ea7c06e199f4ac7f9f7b48dd93f3-93b2e790518f4d5787473e4acf41298c 2023-02-08 07:03:18,350 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |----------941a8a477ea07d4f8905b62789d933da/ 2023-02-08 07:03:18,351 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:18,351 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:18,351 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=941a8a477ea07d4f8905b62789d933da-afab8230e018466cafef78aac6ab7d64 2023-02-08 07:03:18,351 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:18,351 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=941a8a477ea07d4f8905b62789d933da-2e40834bfc014aa88fe1b694b2199d30 2023-02-08 07:03:18,351 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |----------b90e49fec73de744aae2309c072367e0/ 2023-02-08 07:03:18,352 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:18,352 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |----------bd93a30a19626092a69882fcdac58e23/ 2023-02-08 07:03:18,352 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:18,352 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |----------c344d75b5acd95336c6451dc11c34e23/ 2023-02-08 07:03:18,352 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:18,352 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:18,353 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c344d75b5acd95336c6451dc11c34e23-a1d5c12e4477491b9dd91522ea21fb9b 2023-02-08 07:03:18,353 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:18,353 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c344d75b5acd95336c6451dc11c34e23-dd0db0e2f85c44888df8c6f948eac825 2023-02-08 07:03:18,353 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |----------ef8f74b75cb8a75fb50619be90b2fdca/ 2023-02-08 07:03:18,354 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:18,354 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:18,354 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ef8f74b75cb8a75fb50619be90b2fdca-9da0d75c48be43d48063b785ef4e2fd4 2023-02-08 07:03:18,354 DEBUG [Listener at localhost/35563] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:18,354 DEBUG [Listener at localhost/35563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ef8f74b75cb8a75fb50619be90b2fdca-4c8af141eb03460786fd37b2ca1163ca 2023-02-08 07:03:18,358 INFO [Listener at localhost/35563] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-08 07:03:18,879 DEBUG [Listener at localhost/35563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:18,879 INFO [Listener at localhost/35563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:18,881 DEBUG [Listener at localhost/35563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:18,883 INFO [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:18,884 DEBUG [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1 2023-02-08 07:03:18,884 INFO [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26575cad1b966bdf12197b7268a90ea9 columnFamilyName f1 2023-02-08 07:03:18,888 DEBUG [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1/testWithMockedMapReduceMultiRegion=26575cad1b966bdf12197b7268a90ea9-0f5bc09287ec409d8a6b0f6d1d8a146a 2023-02-08 07:03:18,888 INFO [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] regionserver.HStore(310): Store=26575cad1b966bdf12197b7268a90ea9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:18,888 INFO [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:18,889 DEBUG [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2 2023-02-08 07:03:18,889 INFO [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26575cad1b966bdf12197b7268a90ea9 columnFamilyName f2 2023-02-08 07:03:18,893 DEBUG [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2/testWithMockedMapReduceMultiRegion=26575cad1b966bdf12197b7268a90ea9-61c4b5ba3ebd4703bdb70109d1afc09e 2023-02-08 07:03:18,893 INFO [StoreOpener-26575cad1b966bdf12197b7268a90ea9-1] regionserver.HStore(310): Store=26575cad1b966bdf12197b7268a90ea9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:18,893 DEBUG [Listener at localhost/35563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:18,893 INFO [Listener at localhost/35563] regionserver.HRegion(1071): Opened 26575cad1b966bdf12197b7268a90ea9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64216449, jitterRate=-0.04310034215450287}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:18,893 DEBUG [Listener at localhost/35563] regionserver.HRegion(964): Region open journal for 26575cad1b966bdf12197b7268a90ea9: Writing region info on filesystem at 1675839798881Initializing all the Stores at 1675839798882 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839798882Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839798882Region opened successfully at 1675839798893 (+11 ms) 2023-02-08 07:03:18,901 DEBUG [Listener at localhost/35563] regionserver.HRegion(1603): Closing 26575cad1b966bdf12197b7268a90ea9, disabling compactions & flushes 2023-02-08 07:03:18,901 INFO [Listener at localhost/35563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:18,902 DEBUG [Listener at localhost/35563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:18,902 DEBUG [Listener at localhost/35563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. after waiting 0 ms 2023-02-08 07:03:18,902 DEBUG [Listener at localhost/35563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:18,904 INFO [Listener at localhost/35563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:18,904 DEBUG [Listener at localhost/35563] regionserver.HRegion(1557): Region close journal for 26575cad1b966bdf12197b7268a90ea9: Waiting for close lock at 1675839798901Disabling compacts and flushes for region at 1675839798901Disabling writes for close at 1675839798902 (+1 ms)Writing region close event to WAL at 1675839798904 (+2 ms)Closed at 1675839798904 2023-02-08 07:03:18,905 DEBUG [Listener at localhost/35563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:18,905 INFO [Listener at localhost/35563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:18,907 DEBUG [Listener at localhost/35563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:18,909 INFO [StoreOpener-84049d23f1836ed1456960a4993876e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:18,909 DEBUG [StoreOpener-84049d23f1836ed1456960a4993876e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1 2023-02-08 07:03:18,910 INFO [StoreOpener-84049d23f1836ed1456960a4993876e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84049d23f1836ed1456960a4993876e6 columnFamilyName f1 2023-02-08 07:03:18,913 DEBUG [StoreOpener-84049d23f1836ed1456960a4993876e6-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1/testWithMockedMapReduceMultiRegion=84049d23f1836ed1456960a4993876e6-0ab743e981b849219aacf8e1005d5b6e 2023-02-08 07:03:18,913 INFO [StoreOpener-84049d23f1836ed1456960a4993876e6-1] regionserver.HStore(310): Store=84049d23f1836ed1456960a4993876e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:18,914 INFO [StoreOpener-84049d23f1836ed1456960a4993876e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:18,914 DEBUG [StoreOpener-84049d23f1836ed1456960a4993876e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2 2023-02-08 07:03:18,915 INFO [StoreOpener-84049d23f1836ed1456960a4993876e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84049d23f1836ed1456960a4993876e6 columnFamilyName f2 2023-02-08 07:03:18,918 DEBUG [StoreOpener-84049d23f1836ed1456960a4993876e6-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2/testWithMockedMapReduceMultiRegion=84049d23f1836ed1456960a4993876e6-d68456cb9765442297adf30ad39db6fa 2023-02-08 07:03:18,918 INFO [StoreOpener-84049d23f1836ed1456960a4993876e6-1] regionserver.HStore(310): Store=84049d23f1836ed1456960a4993876e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:18,918 DEBUG [Listener at localhost/35563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:18,918 INFO [Listener at localhost/35563] regionserver.HRegion(1071): Opened 84049d23f1836ed1456960a4993876e6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64326755, jitterRate=-0.04145665466785431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:18,918 DEBUG [Listener at localhost/35563] regionserver.HRegion(964): Region open journal for 84049d23f1836ed1456960a4993876e6: Writing region info on filesystem at 1675839798907Initializing all the Stores at 1675839798907Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839798907Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839798908 (+1 ms)Region opened successfully at 1675839798918 (+10 ms) 2023-02-08 07:03:18,927 DEBUG [Listener at localhost/35563] regionserver.HRegion(1603): Closing 84049d23f1836ed1456960a4993876e6, disabling compactions & flushes 2023-02-08 07:03:18,928 INFO [Listener at localhost/35563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:18,928 DEBUG [Listener at localhost/35563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:18,928 DEBUG [Listener at localhost/35563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. after waiting 0 ms 2023-02-08 07:03:18,928 DEBUG [Listener at localhost/35563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:18,929 INFO [Listener at localhost/35563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:18,929 DEBUG [Listener at localhost/35563] regionserver.HRegion(1557): Region close journal for 84049d23f1836ed1456960a4993876e6: Waiting for close lock at 1675839798927Disabling compacts and flushes for region at 1675839798927Disabling writes for close at 1675839798928 (+1 ms)Writing region close event to WAL at 1675839798929 (+1 ms)Closed at 1675839798929 2023-02-08 07:03:18,929 DEBUG [Listener at localhost/35563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:18,929 INFO [Listener at localhost/35563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:18,931 DEBUG [Listener at localhost/35563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:18,932 INFO [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:18,933 DEBUG [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1 2023-02-08 07:03:18,934 INFO [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4801b4e0c43dd2e3ec7a967389c4b183 columnFamilyName f1 2023-02-08 07:03:18,937 DEBUG [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1/testWithMockedMapReduceMultiRegion=4801b4e0c43dd2e3ec7a967389c4b183-600fdaf2177f4f0aaaff495687a577c7 2023-02-08 07:03:18,938 INFO [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] regionserver.HStore(310): Store=4801b4e0c43dd2e3ec7a967389c4b183/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:18,938 INFO [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:18,938 DEBUG [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2 2023-02-08 07:03:18,939 INFO [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4801b4e0c43dd2e3ec7a967389c4b183 columnFamilyName f2 2023-02-08 07:03:18,943 DEBUG [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2/testWithMockedMapReduceMultiRegion=4801b4e0c43dd2e3ec7a967389c4b183-ff5f28e6b32541818f20e6b5af1e5567 2023-02-08 07:03:18,943 INFO [StoreOpener-4801b4e0c43dd2e3ec7a967389c4b183-1] regionserver.HStore(310): Store=4801b4e0c43dd2e3ec7a967389c4b183/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:18,943 DEBUG [Listener at localhost/35563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:18,943 INFO [Listener at localhost/35563] regionserver.HRegion(1071): Opened 4801b4e0c43dd2e3ec7a967389c4b183; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64935935, jitterRate=-0.032379165291786194}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:18,943 DEBUG [Listener at localhost/35563] regionserver.HRegion(964): Region open journal for 4801b4e0c43dd2e3ec7a967389c4b183: Writing region info on filesystem at 1675839798931Initializing all the Stores at 1675839798931Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839798932 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839798932Region opened successfully at 1675839798943 (+11 ms) 2023-02-08 07:03:18,952 DEBUG [Listener at localhost/35563] regionserver.HRegion(1603): Closing 4801b4e0c43dd2e3ec7a967389c4b183, disabling compactions & flushes 2023-02-08 07:03:18,952 INFO [Listener at localhost/35563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:18,952 DEBUG [Listener at localhost/35563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:18,952 DEBUG [Listener at localhost/35563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. after waiting 0 ms 2023-02-08 07:03:18,952 DEBUG [Listener at localhost/35563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:18,953 INFO [Listener at localhost/35563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:18,954 DEBUG [Listener at localhost/35563] regionserver.HRegion(1557): Region close journal for 4801b4e0c43dd2e3ec7a967389c4b183: Waiting for close lock at 1675839798952Disabling compacts and flushes for region at 1675839798952Disabling writes for close at 1675839798952Writing region close event to WAL at 1675839798953 (+1 ms)Closed at 1675839798953 2023-02-08 07:03:18,954 DEBUG [Listener at localhost/35563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:18,954 INFO [Listener at localhost/35563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:18,957 DEBUG [Listener at localhost/35563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:18,962 INFO [StoreOpener-b90e49fec73de744aae2309c072367e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:18,963 DEBUG [StoreOpener-b90e49fec73de744aae2309c072367e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/f1 2023-02-08 07:03:18,964 INFO [StoreOpener-b90e49fec73de744aae2309c072367e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b90e49fec73de744aae2309c072367e0 columnFamilyName f1 2023-02-08 07:03:18,964 INFO [StoreOpener-b90e49fec73de744aae2309c072367e0-1] regionserver.HStore(310): Store=b90e49fec73de744aae2309c072367e0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:18,964 INFO [StoreOpener-b90e49fec73de744aae2309c072367e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:18,965 DEBUG [StoreOpener-b90e49fec73de744aae2309c072367e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/f2 2023-02-08 07:03:18,966 INFO [StoreOpener-b90e49fec73de744aae2309c072367e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b90e49fec73de744aae2309c072367e0 columnFamilyName f2 2023-02-08 07:03:18,966 INFO [StoreOpener-b90e49fec73de744aae2309c072367e0-1] regionserver.HStore(310): Store=b90e49fec73de744aae2309c072367e0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:18,966 DEBUG [Listener at localhost/35563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:18,966 INFO [Listener at localhost/35563] regionserver.HRegion(1071): Opened b90e49fec73de744aae2309c072367e0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66580632, jitterRate=-0.007871270179748535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:18,967 DEBUG [Listener at localhost/35563] regionserver.HRegion(964): Region open journal for b90e49fec73de744aae2309c072367e0: Writing region info on filesystem at 1675839798957Initializing all the Stores at 1675839798958 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839798958Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839798961 (+3 ms)Region opened successfully at 1675839798967 (+6 ms) 2023-02-08 07:03:18,967 DEBUG [Listener at localhost/35563] regionserver.HRegion(1603): Closing b90e49fec73de744aae2309c072367e0, disabling compactions & flushes 2023-02-08 07:03:18,967 INFO [Listener at localhost/35563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:18,967 DEBUG [Listener at localhost/35563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:18,967 DEBUG [Listener at localhost/35563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. after waiting 0 ms 2023-02-08 07:03:18,967 DEBUG [Listener at localhost/35563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:18,968 INFO [Listener at localhost/35563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:18,968 DEBUG [Listener at localhost/35563] regionserver.HRegion(1557): Region close journal for b90e49fec73de744aae2309c072367e0: Waiting for close lock at 1675839798967Disabling compacts and flushes for region at 1675839798967Disabling writes for close at 1675839798967Writing region close event to WAL at 1675839798968 (+1 ms)Closed at 1675839798968 2023-02-08 07:03:18,969 DEBUG [Listener at localhost/35563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:18,969 INFO [Listener at localhost/35563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:18,971 DEBUG [Listener at localhost/35563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:18,977 INFO [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:18,978 DEBUG [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1 2023-02-08 07:03:18,978 INFO [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88b0ea7c06e199f4ac7f9f7b48dd93f3 columnFamilyName f1 2023-02-08 07:03:18,982 DEBUG [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1/testWithMockedMapReduceMultiRegion=88b0ea7c06e199f4ac7f9f7b48dd93f3-25dcf645855e404f9364b5f0203becf1 2023-02-08 07:03:18,983 INFO [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] regionserver.HStore(310): Store=88b0ea7c06e199f4ac7f9f7b48dd93f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:18,983 INFO [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:18,983 DEBUG [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2 2023-02-08 07:03:18,984 INFO [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88b0ea7c06e199f4ac7f9f7b48dd93f3 columnFamilyName f2 2023-02-08 07:03:18,988 DEBUG [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2/testWithMockedMapReduceMultiRegion=88b0ea7c06e199f4ac7f9f7b48dd93f3-93b2e790518f4d5787473e4acf41298c 2023-02-08 07:03:18,988 INFO [StoreOpener-88b0ea7c06e199f4ac7f9f7b48dd93f3-1] regionserver.HStore(310): Store=88b0ea7c06e199f4ac7f9f7b48dd93f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:18,989 DEBUG [Listener at localhost/35563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:18,989 INFO [Listener at localhost/35563] regionserver.HRegion(1071): Opened 88b0ea7c06e199f4ac7f9f7b48dd93f3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64553869, jitterRate=-0.03807239234447479}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:18,989 DEBUG [Listener at localhost/35563] regionserver.HRegion(964): Region open journal for 88b0ea7c06e199f4ac7f9f7b48dd93f3: Writing region info on filesystem at 1675839798971Initializing all the Stores at 1675839798972 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839798972Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839798976 (+4 ms)Region opened successfully at 1675839798989 (+13 ms) 2023-02-08 07:03:19,002 DEBUG [Listener at localhost/35563] regionserver.HRegion(1603): Closing 88b0ea7c06e199f4ac7f9f7b48dd93f3, disabling compactions & flushes 2023-02-08 07:03:19,002 INFO [Listener at localhost/35563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:19,002 DEBUG [Listener at localhost/35563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:19,002 DEBUG [Listener at localhost/35563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. after waiting 0 ms 2023-02-08 07:03:19,002 DEBUG [Listener at localhost/35563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:19,003 INFO [Listener at localhost/35563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:19,003 DEBUG [Listener at localhost/35563] regionserver.HRegion(1557): Region close journal for 88b0ea7c06e199f4ac7f9f7b48dd93f3: Waiting for close lock at 1675839799002Disabling compacts and flushes for region at 1675839799002Disabling writes for close at 1675839799002Writing region close event to WAL at 1675839799003 (+1 ms)Closed at 1675839799003 2023-02-08 07:03:19,004 DEBUG [Listener at localhost/35563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:19,004 INFO [Listener at localhost/35563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:19,005 DEBUG [Listener at localhost/35563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:19,007 INFO [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:19,008 DEBUG [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1 2023-02-08 07:03:19,008 INFO [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52d462aa8eb46c1b3d5399c511d8a9bf columnFamilyName f1 2023-02-08 07:03:19,013 DEBUG [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1/testWithMockedMapReduceMultiRegion=52d462aa8eb46c1b3d5399c511d8a9bf-edd6cee5329f429aa74973995599db89 2023-02-08 07:03:19,013 INFO [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] regionserver.HStore(310): Store=52d462aa8eb46c1b3d5399c511d8a9bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:19,014 INFO [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:19,014 DEBUG [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2 2023-02-08 07:03:19,015 INFO [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52d462aa8eb46c1b3d5399c511d8a9bf columnFamilyName f2 2023-02-08 07:03:19,019 DEBUG [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2/testWithMockedMapReduceMultiRegion=52d462aa8eb46c1b3d5399c511d8a9bf-ec3a2e7fa5e34f5db5bdd2044ddbc2f3 2023-02-08 07:03:19,019 INFO [StoreOpener-52d462aa8eb46c1b3d5399c511d8a9bf-1] regionserver.HStore(310): Store=52d462aa8eb46c1b3d5399c511d8a9bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:19,019 DEBUG [Listener at localhost/35563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:19,020 INFO [Listener at localhost/35563] regionserver.HRegion(1071): Opened 52d462aa8eb46c1b3d5399c511d8a9bf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66819136, jitterRate=-0.004317283630371094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:19,020 DEBUG [Listener at localhost/35563] regionserver.HRegion(964): Region open journal for 52d462aa8eb46c1b3d5399c511d8a9bf: Writing region info on filesystem at 1675839799005Initializing all the Stores at 1675839799006 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839799006Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839799006Region opened successfully at 1675839799020 (+14 ms) 2023-02-08 07:03:19,029 DEBUG [Listener at localhost/35563] regionserver.HRegion(1603): Closing 52d462aa8eb46c1b3d5399c511d8a9bf, disabling compactions & flushes 2023-02-08 07:03:19,029 INFO [Listener at localhost/35563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:19,029 DEBUG [Listener at localhost/35563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:19,029 DEBUG [Listener at localhost/35563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. after waiting 0 ms 2023-02-08 07:03:19,029 DEBUG [Listener at localhost/35563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:19,030 INFO [Listener at localhost/35563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:19,030 DEBUG [Listener at localhost/35563] regionserver.HRegion(1557): Region close journal for 52d462aa8eb46c1b3d5399c511d8a9bf: Waiting for close lock at 1675839799029Disabling compacts and flushes for region at 1675839799029Disabling writes for close at 1675839799029Writing region close event to WAL at 1675839799030 (+1 ms)Closed at 1675839799030 2023-02-08 07:03:19,031 DEBUG [Listener at localhost/35563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:19,031 INFO [Listener at localhost/35563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:19,032 DEBUG [Listener at localhost/35563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:19,034 INFO [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:19,035 DEBUG [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1 2023-02-08 07:03:19,036 INFO [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef8f74b75cb8a75fb50619be90b2fdca columnFamilyName f1 2023-02-08 07:03:19,040 DEBUG [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1/testWithMockedMapReduceMultiRegion=ef8f74b75cb8a75fb50619be90b2fdca-9da0d75c48be43d48063b785ef4e2fd4 2023-02-08 07:03:19,040 INFO [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] regionserver.HStore(310): Store=ef8f74b75cb8a75fb50619be90b2fdca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:19,041 INFO [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:19,041 DEBUG [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2 2023-02-08 07:03:19,042 INFO [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef8f74b75cb8a75fb50619be90b2fdca columnFamilyName f2 2023-02-08 07:03:19,049 DEBUG [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2/testWithMockedMapReduceMultiRegion=ef8f74b75cb8a75fb50619be90b2fdca-4c8af141eb03460786fd37b2ca1163ca 2023-02-08 07:03:19,049 INFO [StoreOpener-ef8f74b75cb8a75fb50619be90b2fdca-1] regionserver.HStore(310): Store=ef8f74b75cb8a75fb50619be90b2fdca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:19,050 DEBUG [Listener at localhost/35563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:19,050 INFO [Listener at localhost/35563] regionserver.HRegion(1071): Opened ef8f74b75cb8a75fb50619be90b2fdca; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73582504, jitterRate=0.09646475315093994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:19,050 DEBUG [Listener at localhost/35563] regionserver.HRegion(964): Region open journal for ef8f74b75cb8a75fb50619be90b2fdca: Writing region info on filesystem at 1675839799032Initializing all the Stores at 1675839799033 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839799033Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839799033Region opened successfully at 1675839799050 (+17 ms) 2023-02-08 07:03:19,060 DEBUG [Listener at localhost/35563] regionserver.HRegion(1603): Closing ef8f74b75cb8a75fb50619be90b2fdca, disabling compactions & flushes 2023-02-08 07:03:19,060 INFO [Listener at localhost/35563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:19,060 DEBUG [Listener at localhost/35563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:19,060 DEBUG [Listener at localhost/35563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. after waiting 0 ms 2023-02-08 07:03:19,060 DEBUG [Listener at localhost/35563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:19,061 INFO [Listener at localhost/35563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:19,061 DEBUG [Listener at localhost/35563] regionserver.HRegion(1557): Region close journal for ef8f74b75cb8a75fb50619be90b2fdca: Waiting for close lock at 1675839799060Disabling compacts and flushes for region at 1675839799060Disabling writes for close at 1675839799060Writing region close event to WAL at 1675839799061 (+1 ms)Closed at 1675839799061 2023-02-08 07:03:19,061 DEBUG [Listener at localhost/35563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:19,061 INFO [Listener at localhost/35563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:19,063 DEBUG [Listener at localhost/35563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:19,064 INFO [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:19,066 DEBUG [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/f1 2023-02-08 07:03:19,066 INFO [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd93a30a19626092a69882fcdac58e23 columnFamilyName f1 2023-02-08 07:03:19,066 INFO [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] regionserver.HStore(310): Store=bd93a30a19626092a69882fcdac58e23/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:19,066 INFO [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:19,067 DEBUG [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/f2 2023-02-08 07:03:19,067 INFO [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd93a30a19626092a69882fcdac58e23 columnFamilyName f2 2023-02-08 07:03:19,068 INFO [StoreOpener-bd93a30a19626092a69882fcdac58e23-1] regionserver.HStore(310): Store=bd93a30a19626092a69882fcdac58e23/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:19,068 DEBUG [Listener at localhost/35563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:19,068 INFO [Listener at localhost/35563] regionserver.HRegion(1071): Opened bd93a30a19626092a69882fcdac58e23; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74321744, jitterRate=0.10748028755187988}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:19,068 DEBUG [Listener at localhost/35563] regionserver.HRegion(964): Region open journal for bd93a30a19626092a69882fcdac58e23: Writing region info on filesystem at 1675839799063Initializing all the Stores at 1675839799063Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839799063Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839799063Region opened successfully at 1675839799068 (+5 ms) 2023-02-08 07:03:19,069 DEBUG [Listener at localhost/35563] regionserver.HRegion(1603): Closing bd93a30a19626092a69882fcdac58e23, disabling compactions & flushes 2023-02-08 07:03:19,069 INFO [Listener at localhost/35563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:19,069 DEBUG [Listener at localhost/35563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:19,069 DEBUG [Listener at localhost/35563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. after waiting 0 ms 2023-02-08 07:03:19,069 DEBUG [Listener at localhost/35563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:19,069 INFO [Listener at localhost/35563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:19,069 DEBUG [Listener at localhost/35563] regionserver.HRegion(1557): Region close journal for bd93a30a19626092a69882fcdac58e23: Waiting for close lock at 1675839799069Disabling compacts and flushes for region at 1675839799069Disabling writes for close at 1675839799069Writing region close event to WAL at 1675839799069Closed at 1675839799069 2023-02-08 07:03:19,070 DEBUG [Listener at localhost/35563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:19,070 INFO [Listener at localhost/35563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:19,071 DEBUG [Listener at localhost/35563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:19,073 INFO [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:19,073 DEBUG [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1 2023-02-08 07:03:19,074 INFO [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 941a8a477ea07d4f8905b62789d933da columnFamilyName f1 2023-02-08 07:03:19,077 DEBUG [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1/testWithMockedMapReduceMultiRegion=941a8a477ea07d4f8905b62789d933da-afab8230e018466cafef78aac6ab7d64 2023-02-08 07:03:19,078 INFO [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] regionserver.HStore(310): Store=941a8a477ea07d4f8905b62789d933da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:19,078 INFO [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:19,078 DEBUG [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2 2023-02-08 07:03:19,079 INFO [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 941a8a477ea07d4f8905b62789d933da columnFamilyName f2 2023-02-08 07:03:19,082 DEBUG [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2/testWithMockedMapReduceMultiRegion=941a8a477ea07d4f8905b62789d933da-2e40834bfc014aa88fe1b694b2199d30 2023-02-08 07:03:19,083 INFO [StoreOpener-941a8a477ea07d4f8905b62789d933da-1] regionserver.HStore(310): Store=941a8a477ea07d4f8905b62789d933da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:19,083 DEBUG [Listener at localhost/35563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:19,083 INFO [Listener at localhost/35563] regionserver.HRegion(1071): Opened 941a8a477ea07d4f8905b62789d933da; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64155025, jitterRate=-0.04401563107967377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:19,083 DEBUG [Listener at localhost/35563] regionserver.HRegion(964): Region open journal for 941a8a477ea07d4f8905b62789d933da: Writing region info on filesystem at 1675839799071Initializing all the Stores at 1675839799072 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839799072Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839799072Region opened successfully at 1675839799083 (+11 ms) 2023-02-08 07:03:19,092 DEBUG [Listener at localhost/35563] regionserver.HRegion(1603): Closing 941a8a477ea07d4f8905b62789d933da, disabling compactions & flushes 2023-02-08 07:03:19,092 INFO [Listener at localhost/35563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:19,092 DEBUG [Listener at localhost/35563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:19,092 DEBUG [Listener at localhost/35563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. after waiting 0 ms 2023-02-08 07:03:19,093 DEBUG [Listener at localhost/35563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:19,096 INFO [Listener at localhost/35563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:19,096 DEBUG [Listener at localhost/35563] regionserver.HRegion(1557): Region close journal for 941a8a477ea07d4f8905b62789d933da: Waiting for close lock at 1675839799092Disabling compacts and flushes for region at 1675839799092Disabling writes for close at 1675839799093 (+1 ms)Writing region close event to WAL at 1675839799096 (+3 ms)Closed at 1675839799096 2023-02-08 07:03:19,096 DEBUG [Listener at localhost/35563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:19,097 INFO [Listener at localhost/35563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:19,098 DEBUG [Listener at localhost/35563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:19,100 INFO [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:19,100 DEBUG [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1 2023-02-08 07:03:19,101 INFO [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c344d75b5acd95336c6451dc11c34e23 columnFamilyName f1 2023-02-08 07:03:19,105 DEBUG [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1/testWithMockedMapReduceMultiRegion=c344d75b5acd95336c6451dc11c34e23-a1d5c12e4477491b9dd91522ea21fb9b 2023-02-08 07:03:19,105 INFO [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] regionserver.HStore(310): Store=c344d75b5acd95336c6451dc11c34e23/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:19,105 INFO [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:19,106 DEBUG [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2 2023-02-08 07:03:19,106 INFO [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c344d75b5acd95336c6451dc11c34e23 columnFamilyName f2 2023-02-08 07:03:19,109 DEBUG [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] regionserver.HStore(539): loaded hdfs://localhost:44939/user/jenkins/test-data/0eec85b7-e33c-dd5d-afbf-fb010506a38e/testWithMockedMapReduceMultiRegion/73725e52-a261-4f67-a620-120889194a92/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2/testWithMockedMapReduceMultiRegion=c344d75b5acd95336c6451dc11c34e23-dd0db0e2f85c44888df8c6f948eac825 2023-02-08 07:03:19,110 INFO [StoreOpener-c344d75b5acd95336c6451dc11c34e23-1] regionserver.HStore(310): Store=c344d75b5acd95336c6451dc11c34e23/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:19,110 DEBUG [Listener at localhost/35563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:19,110 INFO [Listener at localhost/35563] regionserver.HRegion(1071): Opened c344d75b5acd95336c6451dc11c34e23; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70307877, jitterRate=0.04766900837421417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:19,110 DEBUG [Listener at localhost/35563] regionserver.HRegion(964): Region open journal for c344d75b5acd95336c6451dc11c34e23: Writing region info on filesystem at 1675839799098Initializing all the Stores at 1675839799099 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839799099Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839799099Region opened successfully at 1675839799110 (+11 ms) 2023-02-08 07:03:19,117 DEBUG [Listener at localhost/35563] regionserver.HRegion(1603): Closing c344d75b5acd95336c6451dc11c34e23, disabling compactions & flushes 2023-02-08 07:03:19,117 INFO [Listener at localhost/35563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:19,117 DEBUG [Listener at localhost/35563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:19,118 DEBUG [Listener at localhost/35563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. after waiting 0 ms 2023-02-08 07:03:19,118 DEBUG [Listener at localhost/35563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:19,118 INFO [Listener at localhost/35563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:19,118 DEBUG [Listener at localhost/35563] regionserver.HRegion(1557): Region close journal for c344d75b5acd95336c6451dc11c34e23: Waiting for close lock at 1675839799117Disabling compacts and flushes for region at 1675839799117Disabling writes for close at 1675839799118 (+1 ms)Writing region close event to WAL at 1675839799118Closed at 1675839799118 2023-02-08 07:03:19,122 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:19,122 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:19,123 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-08 07:03:19,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-08 07:03:19,125 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:19,125 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:19,126 INFO [Listener at localhost/35563] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-08 07:03:19,126 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-08 07:03:19,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:19,128 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:19,129 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:19,129 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839799129"}]},"ts":"1675839799129"} 2023-02-08 07:03:19,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 07:03:19,130 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-08 07:03:19,132 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-08 07:03:19,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bd93a30a19626092a69882fcdac58e23, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef8f74b75cb8a75fb50619be90b2fdca, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84049d23f1836ed1456960a4993876e6, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=26575cad1b966bdf12197b7268a90ea9, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4801b4e0c43dd2e3ec7a967389c4b183, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=88b0ea7c06e199f4ac7f9f7b48dd93f3, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c344d75b5acd95336c6451dc11c34e23, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=52d462aa8eb46c1b3d5399c511d8a9bf, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=941a8a477ea07d4f8905b62789d933da, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b90e49fec73de744aae2309c072367e0, UNASSIGN}] 2023-02-08 07:03:19,134 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef8f74b75cb8a75fb50619be90b2fdca, UNASSIGN 2023-02-08 07:03:19,134 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84049d23f1836ed1456960a4993876e6, UNASSIGN 2023-02-08 07:03:19,135 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bd93a30a19626092a69882fcdac58e23, UNASSIGN 2023-02-08 07:03:19,135 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4801b4e0c43dd2e3ec7a967389c4b183, UNASSIGN 2023-02-08 07:03:19,135 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b90e49fec73de744aae2309c072367e0, UNASSIGN 2023-02-08 07:03:19,135 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=ef8f74b75cb8a75fb50619be90b2fdca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:19,135 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=84049d23f1836ed1456960a4993876e6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:19,135 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799135"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839799135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839799135"}]},"ts":"1675839799135"} 2023-02-08 07:03:19,135 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675839795507.84049d23f1836ed1456960a4993876e6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799135"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839799135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839799135"}]},"ts":"1675839799135"} 2023-02-08 07:03:19,135 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b90e49fec73de744aae2309c072367e0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:19,135 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=bd93a30a19626092a69882fcdac58e23, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:19,135 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4801b4e0c43dd2e3ec7a967389c4b183, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:19,136 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675839799135"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839799135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839799135"}]},"ts":"1675839799135"} 2023-02-08 07:03:19,135 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675839799135"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839799135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839799135"}]},"ts":"1675839799135"} 2023-02-08 07:03:19,136 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799135"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839799135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839799135"}]},"ts":"1675839799135"} 2023-02-08 07:03:19,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=35, state=RUNNABLE; CloseRegionProcedure ef8f74b75cb8a75fb50619be90b2fdca, server=jenkins-hbase4.apache.org,35101,1675839794238}] 2023-02-08 07:03:19,137 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=36, state=RUNNABLE; CloseRegionProcedure 84049d23f1836ed1456960a4993876e6, server=jenkins-hbase4.apache.org,43331,1675839794266}] 2023-02-08 07:03:19,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=34, state=RUNNABLE; CloseRegionProcedure bd93a30a19626092a69882fcdac58e23, server=jenkins-hbase4.apache.org,35101,1675839794238}] 2023-02-08 07:03:19,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure b90e49fec73de744aae2309c072367e0, server=jenkins-hbase4.apache.org,43331,1675839794266}] 2023-02-08 07:03:19,139 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=941a8a477ea07d4f8905b62789d933da, UNASSIGN 2023-02-08 07:03:19,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=38, state=RUNNABLE; CloseRegionProcedure 4801b4e0c43dd2e3ec7a967389c4b183, server=jenkins-hbase4.apache.org,35101,1675839794238}] 2023-02-08 07:03:19,140 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=52d462aa8eb46c1b3d5399c511d8a9bf, UNASSIGN 2023-02-08 07:03:19,140 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=941a8a477ea07d4f8905b62789d933da, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:19,140 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799140"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839799140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839799140"}]},"ts":"1675839799140"} 2023-02-08 07:03:19,141 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c344d75b5acd95336c6451dc11c34e23, UNASSIGN 2023-02-08 07:03:19,141 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=52d462aa8eb46c1b3d5399c511d8a9bf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:19,141 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839799141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839799141"}]},"ts":"1675839799141"} 2023-02-08 07:03:19,141 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c344d75b5acd95336c6451dc11c34e23, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:19,142 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839799141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839799141"}]},"ts":"1675839799141"} 2023-02-08 07:03:19,142 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=88b0ea7c06e199f4ac7f9f7b48dd93f3, UNASSIGN 2023-02-08 07:03:19,142 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 941a8a477ea07d4f8905b62789d933da, server=jenkins-hbase4.apache.org,35101,1675839794238}] 2023-02-08 07:03:19,142 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=26575cad1b966bdf12197b7268a90ea9, UNASSIGN 2023-02-08 07:03:19,142 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=88b0ea7c06e199f4ac7f9f7b48dd93f3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:19,143 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839799142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839799142"}]},"ts":"1675839799142"} 2023-02-08 07:03:19,143 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=26575cad1b966bdf12197b7268a90ea9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:19,143 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799143"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839799143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839799143"}]},"ts":"1675839799143"} 2023-02-08 07:03:19,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=40, state=RUNNABLE; CloseRegionProcedure c344d75b5acd95336c6451dc11c34e23, server=jenkins-hbase4.apache.org,43331,1675839794266}] 2023-02-08 07:03:19,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=41, state=RUNNABLE; CloseRegionProcedure 52d462aa8eb46c1b3d5399c511d8a9bf, server=jenkins-hbase4.apache.org,35101,1675839794238}] 2023-02-08 07:03:19,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 88b0ea7c06e199f4ac7f9f7b48dd93f3, server=jenkins-hbase4.apache.org,43331,1675839794266}] 2023-02-08 07:03:19,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=37, state=RUNNABLE; CloseRegionProcedure 26575cad1b966bdf12197b7268a90ea9, server=jenkins-hbase4.apache.org,43331,1675839794266}] 2023-02-08 07:03:19,230 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:19,230 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:19,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 07:03:19,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:19,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 941a8a477ea07d4f8905b62789d933da, disabling compactions & flushes 2023-02-08 07:03:19,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:19,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:19,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. after waiting 0 ms 2023-02-08 07:03:19,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:19,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:19,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b90e49fec73de744aae2309c072367e0, disabling compactions & flushes 2023-02-08 07:03:19,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:19,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:19,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. after waiting 0 ms 2023-02-08 07:03:19,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:19,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:19,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 07:03:19,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da. 2023-02-08 07:03:19,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0. 2023-02-08 07:03:19,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 941a8a477ea07d4f8905b62789d933da: Waiting for close lock at 1675839799289Running coprocessor pre-close hooks at 1675839799289Disabling compacts and flushes for region at 1675839799289Disabling writes for close at 1675839799289Writing region close event to WAL at 1675839799290 (+1 ms)Running coprocessor post-close hooks at 1675839799294 (+4 ms)Closed at 1675839799294 2023-02-08 07:03:19,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b90e49fec73de744aae2309c072367e0: Waiting for close lock at 1675839799291Running coprocessor pre-close hooks at 1675839799291Disabling compacts and flushes for region at 1675839799291Disabling writes for close at 1675839799291Writing region close event to WAL at 1675839799291Running coprocessor post-close hooks at 1675839799294 (+3 ms)Closed at 1675839799294 2023-02-08 07:03:19,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:19,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:19,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 52d462aa8eb46c1b3d5399c511d8a9bf, disabling compactions & flushes 2023-02-08 07:03:19,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:19,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:19,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. after waiting 0 ms 2023-02-08 07:03:19,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:19,296 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=941a8a477ea07d4f8905b62789d933da, regionState=CLOSED 2023-02-08 07:03:19,296 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839799296"}]},"ts":"1675839799296"} 2023-02-08 07:03:19,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:19,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:19,296 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b90e49fec73de744aae2309c072367e0, regionState=CLOSED 2023-02-08 07:03:19,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 88b0ea7c06e199f4ac7f9f7b48dd93f3, disabling compactions & flushes 2023-02-08 07:03:19,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:19,297 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675839799296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839799296"}]},"ts":"1675839799296"} 2023-02-08 07:03:19,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:19,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. after waiting 0 ms 2023-02-08 07:03:19,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:19,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-08 07:03:19,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 941a8a477ea07d4f8905b62789d933da, server=jenkins-hbase4.apache.org,35101,1675839794238 in 155 msec 2023-02-08 07:03:19,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-08 07:03:19,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:19,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure b90e49fec73de744aae2309c072367e0, server=jenkins-hbase4.apache.org,43331,1675839794266 in 159 msec 2023-02-08 07:03:19,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf. 2023-02-08 07:03:19,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 52d462aa8eb46c1b3d5399c511d8a9bf: Waiting for close lock at 1675839799296Running coprocessor pre-close hooks at 1675839799296Disabling compacts and flushes for region at 1675839799296Disabling writes for close at 1675839799296Writing region close event to WAL at 1675839799297 (+1 ms)Running coprocessor post-close hooks at 1675839799302 (+5 ms)Closed at 1675839799302 2023-02-08 07:03:19,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=941a8a477ea07d4f8905b62789d933da, UNASSIGN in 169 msec 2023-02-08 07:03:19,303 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b90e49fec73de744aae2309c072367e0, UNASSIGN in 169 msec 2023-02-08 07:03:19,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:19,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:19,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ef8f74b75cb8a75fb50619be90b2fdca, disabling compactions & flushes 2023-02-08 07:03:19,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:19,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:19,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. after waiting 0 ms 2023-02-08 07:03:19,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:19,304 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=52d462aa8eb46c1b3d5399c511d8a9bf, regionState=CLOSED 2023-02-08 07:03:19,304 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799304"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839799304"}]},"ts":"1675839799304"} 2023-02-08 07:03:19,306 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=41 2023-02-08 07:03:19,306 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=41, state=SUCCESS; CloseRegionProcedure 52d462aa8eb46c1b3d5399c511d8a9bf, server=jenkins-hbase4.apache.org,35101,1675839794238 in 161 msec 2023-02-08 07:03:19,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=52d462aa8eb46c1b3d5399c511d8a9bf, UNASSIGN in 174 msec 2023-02-08 07:03:19,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:19,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3. 2023-02-08 07:03:19,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 88b0ea7c06e199f4ac7f9f7b48dd93f3: Waiting for close lock at 1675839799296Running coprocessor pre-close hooks at 1675839799296Disabling compacts and flushes for region at 1675839799296Disabling writes for close at 1675839799297 (+1 ms)Writing region close event to WAL at 1675839799297Running coprocessor post-close hooks at 1675839799309 (+12 ms)Closed at 1675839799309 2023-02-08 07:03:19,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:19,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:19,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 84049d23f1836ed1456960a4993876e6, disabling compactions & flushes 2023-02-08 07:03:19,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:19,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:19,311 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=88b0ea7c06e199f4ac7f9f7b48dd93f3, regionState=CLOSED 2023-02-08 07:03:19,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. after waiting 0 ms 2023-02-08 07:03:19,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:19,311 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799310"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839799310"}]},"ts":"1675839799310"} 2023-02-08 07:03:19,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:19,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-08 07:03:19,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 88b0ea7c06e199f4ac7f9f7b48dd93f3, server=jenkins-hbase4.apache.org,43331,1675839794266 in 168 msec 2023-02-08 07:03:19,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=88b0ea7c06e199f4ac7f9f7b48dd93f3, UNASSIGN in 181 msec 2023-02-08 07:03:19,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:19,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca. 2023-02-08 07:03:19,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6. 2023-02-08 07:03:19,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ef8f74b75cb8a75fb50619be90b2fdca: Waiting for close lock at 1675839799303Running coprocessor pre-close hooks at 1675839799303Disabling compacts and flushes for region at 1675839799303Disabling writes for close at 1675839799303Writing region close event to WAL at 1675839799309 (+6 ms)Running coprocessor post-close hooks at 1675839799316 (+7 ms)Closed at 1675839799316 2023-02-08 07:03:19,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 84049d23f1836ed1456960a4993876e6: Waiting for close lock at 1675839799310Running coprocessor pre-close hooks at 1675839799310Disabling compacts and flushes for region at 1675839799310Disabling writes for close at 1675839799311 (+1 ms)Writing region close event to WAL at 1675839799313 (+2 ms)Running coprocessor post-close hooks at 1675839799316 (+3 ms)Closed at 1675839799316 2023-02-08 07:03:19,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:19,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:19,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c344d75b5acd95336c6451dc11c34e23, disabling compactions & flushes 2023-02-08 07:03:19,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:19,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:19,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. after waiting 0 ms 2023-02-08 07:03:19,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:19,320 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=84049d23f1836ed1456960a4993876e6, regionState=CLOSED 2023-02-08 07:03:19,320 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675839795507.84049d23f1836ed1456960a4993876e6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799320"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839799320"}]},"ts":"1675839799320"} 2023-02-08 07:03:19,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:19,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:19,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bd93a30a19626092a69882fcdac58e23, disabling compactions & flushes 2023-02-08 07:03:19,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:19,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:19,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. after waiting 0 ms 2023-02-08 07:03:19,321 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=ef8f74b75cb8a75fb50619be90b2fdca, regionState=CLOSED 2023-02-08 07:03:19,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:19,321 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839799321"}]},"ts":"1675839799321"} 2023-02-08 07:03:19,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:19,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23. 2023-02-08 07:03:19,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c344d75b5acd95336c6451dc11c34e23: Waiting for close lock at 1675839799317Running coprocessor pre-close hooks at 1675839799317Disabling compacts and flushes for region at 1675839799317Disabling writes for close at 1675839799318 (+1 ms)Writing region close event to WAL at 1675839799319 (+1 ms)Running coprocessor post-close hooks at 1675839799323 (+4 ms)Closed at 1675839799323 2023-02-08 07:03:19,323 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=36 2023-02-08 07:03:19,323 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=36, state=SUCCESS; CloseRegionProcedure 84049d23f1836ed1456960a4993876e6, server=jenkins-hbase4.apache.org,43331,1675839794266 in 185 msec 2023-02-08 07:03:19,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=35 2023-02-08 07:03:19,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=35, state=SUCCESS; CloseRegionProcedure ef8f74b75cb8a75fb50619be90b2fdca, server=jenkins-hbase4.apache.org,35101,1675839794238 in 186 msec 2023-02-08 07:03:19,325 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84049d23f1836ed1456960a4993876e6, UNASSIGN in 192 msec 2023-02-08 07:03:19,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef8f74b75cb8a75fb50619be90b2fdca, UNASSIGN in 193 msec 2023-02-08 07:03:19,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:19,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:19,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 26575cad1b966bdf12197b7268a90ea9, disabling compactions & flushes 2023-02-08 07:03:19,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:19,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:19,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. after waiting 0 ms 2023-02-08 07:03:19,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 07:03:19,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:19,327 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c344d75b5acd95336c6451dc11c34e23, regionState=CLOSED 2023-02-08 07:03:19,327 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799327"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839799327"}]},"ts":"1675839799327"} 2023-02-08 07:03:19,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23. 2023-02-08 07:03:19,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bd93a30a19626092a69882fcdac58e23: Waiting for close lock at 1675839799321Running coprocessor pre-close hooks at 1675839799321Disabling compacts and flushes for region at 1675839799321Disabling writes for close at 1675839799321Writing region close event to WAL at 1675839799321Running coprocessor post-close hooks at 1675839799327 (+6 ms)Closed at 1675839799327 2023-02-08 07:03:19,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:19,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:19,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4801b4e0c43dd2e3ec7a967389c4b183, disabling compactions & flushes 2023-02-08 07:03:19,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:19,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:19,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. after waiting 0 ms 2023-02-08 07:03:19,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:19,329 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=bd93a30a19626092a69882fcdac58e23, regionState=CLOSED 2023-02-08 07:03:19,329 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675839799329"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839799329"}]},"ts":"1675839799329"} 2023-02-08 07:03:19,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=40 2023-02-08 07:03:19,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=40, state=SUCCESS; CloseRegionProcedure c344d75b5acd95336c6451dc11c34e23, server=jenkins-hbase4.apache.org,43331,1675839794266 in 185 msec 2023-02-08 07:03:19,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:19,332 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c344d75b5acd95336c6451dc11c34e23, UNASSIGN in 198 msec 2023-02-08 07:03:19,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9. 2023-02-08 07:03:19,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 26575cad1b966bdf12197b7268a90ea9: Waiting for close lock at 1675839799327Running coprocessor pre-close hooks at 1675839799327Disabling compacts and flushes for region at 1675839799327Disabling writes for close at 1675839799327Writing region close event to WAL at 1675839799328 (+1 ms)Running coprocessor post-close hooks at 1675839799332 (+4 ms)Closed at 1675839799332 2023-02-08 07:03:19,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=34 2023-02-08 07:03:19,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=34, state=SUCCESS; CloseRegionProcedure bd93a30a19626092a69882fcdac58e23, server=jenkins-hbase4.apache.org,35101,1675839794238 in 193 msec 2023-02-08 07:03:19,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:19,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:19,334 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bd93a30a19626092a69882fcdac58e23, UNASSIGN in 201 msec 2023-02-08 07:03:19,334 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=26575cad1b966bdf12197b7268a90ea9, regionState=CLOSED 2023-02-08 07:03:19,334 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799334"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839799334"}]},"ts":"1675839799334"} 2023-02-08 07:03:19,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183. 2023-02-08 07:03:19,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4801b4e0c43dd2e3ec7a967389c4b183: Waiting for close lock at 1675839799329Running coprocessor pre-close hooks at 1675839799329Disabling compacts and flushes for region at 1675839799329Disabling writes for close at 1675839799329Writing region close event to WAL at 1675839799331 (+2 ms)Running coprocessor post-close hooks at 1675839799335 (+4 ms)Closed at 1675839799335 2023-02-08 07:03:19,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:19,337 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4801b4e0c43dd2e3ec7a967389c4b183, regionState=CLOSED 2023-02-08 07:03:19,337 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=37 2023-02-08 07:03:19,337 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=37, state=SUCCESS; CloseRegionProcedure 26575cad1b966bdf12197b7268a90ea9, server=jenkins-hbase4.apache.org,43331,1675839794266 in 188 msec 2023-02-08 07:03:19,337 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675839799337"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839799337"}]},"ts":"1675839799337"} 2023-02-08 07:03:19,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=26575cad1b966bdf12197b7268a90ea9, UNASSIGN in 205 msec 2023-02-08 07:03:19,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=38 2023-02-08 07:03:19,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=38, state=SUCCESS; CloseRegionProcedure 4801b4e0c43dd2e3ec7a967389c4b183, server=jenkins-hbase4.apache.org,35101,1675839794238 in 198 msec 2023-02-08 07:03:19,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=33 2023-02-08 07:03:19,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4801b4e0c43dd2e3ec7a967389c4b183, UNASSIGN in 207 msec 2023-02-08 07:03:19,341 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839799341"}]},"ts":"1675839799341"} 2023-02-08 07:03:19,342 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-08 07:03:19,343 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-08 07:03:19,345 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 218 msec 2023-02-08 07:03:19,431 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:19,432 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:19,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 07:03:19,433 INFO [Listener at localhost/35563] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-08 07:03:19,433 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:19,433 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:19,434 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-08 07:03:19,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:19,436 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:19,436 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:19,436 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:19,437 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:19,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-08 07:03:19,447 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:19,447 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:19,447 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:19,447 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:19,447 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:19,447 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:19,447 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:19,447 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:19,451 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/recovered.edits] 2023-02-08 07:03:19,451 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/recovered.edits] 2023-02-08 07:03:19,452 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/recovered.edits] 2023-02-08 07:03:19,452 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/f1, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/f2, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/recovered.edits] 2023-02-08 07:03:19,452 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/recovered.edits] 2023-02-08 07:03:19,452 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/recovered.edits] 2023-02-08 07:03:19,452 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/recovered.edits] 2023-02-08 07:03:19,453 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/recovered.edits] 2023-02-08 07:03:19,459 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1/25dcf645855e404f9364b5f0203becf1 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1/25dcf645855e404f9364b5f0203becf1 2023-02-08 07:03:19,459 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1/9ab5cc36b3f5473ab62f010beab2d13a to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1/9ab5cc36b3f5473ab62f010beab2d13a 2023-02-08 07:03:19,460 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1/0ab743e981b849219aacf8e1005d5b6e to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1/0ab743e981b849219aacf8e1005d5b6e 2023-02-08 07:03:19,460 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1/0ff794f3d4a0495d857d70646c2a1484 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1/0ff794f3d4a0495d857d70646c2a1484 2023-02-08 07:03:19,460 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1/600fdaf2177f4f0aaaff495687a577c7 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1/600fdaf2177f4f0aaaff495687a577c7 2023-02-08 07:03:19,461 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1/0f5bc09287ec409d8a6b0f6d1d8a146a to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1/0f5bc09287ec409d8a6b0f6d1d8a146a 2023-02-08 07:03:19,461 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1/6ca2a389ca6743d3a5021d2f2027a9c9 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1/6ca2a389ca6743d3a5021d2f2027a9c9 2023-02-08 07:03:19,461 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1/567d9ed4598d42e6911474e63c76f074 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f1/567d9ed4598d42e6911474e63c76f074 2023-02-08 07:03:19,462 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1/9da0d75c48be43d48063b785ef4e2fd4 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f1/9da0d75c48be43d48063b785ef4e2fd4 2023-02-08 07:03:19,463 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1/6e4fe324773d4906b61cb0ff036b6f80 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f1/6e4fe324773d4906b61cb0ff036b6f80 2023-02-08 07:03:19,463 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1/d493615b5e3c4f68abb1d4c21ee203f8 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f1/d493615b5e3c4f68abb1d4c21ee203f8 2023-02-08 07:03:19,464 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1/a1d5c12e4477491b9dd91522ea21fb9b to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f1/a1d5c12e4477491b9dd91522ea21fb9b 2023-02-08 07:03:19,464 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1/9c3af00c9b0b4263862a63d9f73ffd04 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f1/9c3af00c9b0b4263862a63d9f73ffd04 2023-02-08 07:03:19,464 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/recovered.edits/6.seqid to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23/recovered.edits/6.seqid 2023-02-08 07:03:19,465 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1/edd6cee5329f429aa74973995599db89 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f1/edd6cee5329f429aa74973995599db89 2023-02-08 07:03:19,465 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/bd93a30a19626092a69882fcdac58e23 2023-02-08 07:03:19,465 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:19,467 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2/3336cfeb678845fab1c63c7a0ec8a667 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2/3336cfeb678845fab1c63c7a0ec8a667 2023-02-08 07:03:19,468 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2/4c8af141eb03460786fd37b2ca1163ca to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2/4c8af141eb03460786fd37b2ca1163ca 2023-02-08 07:03:19,469 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2/d68456cb9765442297adf30ad39db6fa to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2/d68456cb9765442297adf30ad39db6fa 2023-02-08 07:03:19,469 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2/a8b57cda2a4c4da49cffaf0ff0abf7e6 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2/a8b57cda2a4c4da49cffaf0ff0abf7e6 2023-02-08 07:03:19,470 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2/3eff4b5ee34e4c49b255fcb826ec3b02 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2/3eff4b5ee34e4c49b255fcb826ec3b02 2023-02-08 07:03:19,470 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2/93b2e790518f4d5787473e4acf41298c to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/f2/93b2e790518f4d5787473e4acf41298c 2023-02-08 07:03:19,470 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/recovered.edits] 2023-02-08 07:03:19,471 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2/ec3a2e7fa5e34f5db5bdd2044ddbc2f3 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2/ec3a2e7fa5e34f5db5bdd2044ddbc2f3 2023-02-08 07:03:19,472 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2/dd0db0e2f85c44888df8c6f948eac825 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/f2/dd0db0e2f85c44888df8c6f948eac825 2023-02-08 07:03:19,472 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2/4e803a113af54789bef0e875261af07e to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/f2/4e803a113af54789bef0e875261af07e 2023-02-08 07:03:19,472 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2/353d04a17e934a1ba70c9d9ecbca4286 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2/353d04a17e934a1ba70c9d9ecbca4286 2023-02-08 07:03:19,473 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2/db93814724ce4512a893bcaf4bc13c84 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/f2/db93814724ce4512a893bcaf4bc13c84 2023-02-08 07:03:19,473 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2/ff5f28e6b32541818f20e6b5af1e5567 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/f2/ff5f28e6b32541818f20e6b5af1e5567 2023-02-08 07:03:19,475 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2/f2d5ff6e92a9444bb3940fc5ae3aeb27 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/f2/f2d5ff6e92a9444bb3940fc5ae3aeb27 2023-02-08 07:03:19,476 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2/61c4b5ba3ebd4703bdb70109d1afc09e to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/f2/61c4b5ba3ebd4703bdb70109d1afc09e 2023-02-08 07:03:19,478 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/recovered.edits/12.seqid to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3/recovered.edits/12.seqid 2023-02-08 07:03:19,478 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1/afab8230e018466cafef78aac6ab7d64 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1/afab8230e018466cafef78aac6ab7d64 2023-02-08 07:03:19,479 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/88b0ea7c06e199f4ac7f9f7b48dd93f3 2023-02-08 07:03:19,479 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:19,480 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/recovered.edits/12.seqid to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6/recovered.edits/12.seqid 2023-02-08 07:03:19,481 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/recovered.edits/12.seqid to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca/recovered.edits/12.seqid 2023-02-08 07:03:19,481 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/84049d23f1836ed1456960a4993876e6 2023-02-08 07:03:19,482 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/recovered.edits/12.seqid to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183/recovered.edits/12.seqid 2023-02-08 07:03:19,483 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef8f74b75cb8a75fb50619be90b2fdca 2023-02-08 07:03:19,483 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/recovered.edits/12.seqid to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23/recovered.edits/12.seqid 2023-02-08 07:03:19,483 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/4801b4e0c43dd2e3ec7a967389c4b183 2023-02-08 07:03:19,483 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1/bed4c782dfea4516abcec048b63e8f09 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f1/bed4c782dfea4516abcec048b63e8f09 2023-02-08 07:03:19,483 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/recovered.edits/12.seqid to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf/recovered.edits/12.seqid 2023-02-08 07:03:19,484 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/f1, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/f2, FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/recovered.edits] 2023-02-08 07:03:19,484 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/c344d75b5acd95336c6451dc11c34e23 2023-02-08 07:03:19,484 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/52d462aa8eb46c1b3d5399c511d8a9bf 2023-02-08 07:03:19,485 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/recovered.edits/12.seqid to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9/recovered.edits/12.seqid 2023-02-08 07:03:19,486 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/26575cad1b966bdf12197b7268a90ea9 2023-02-08 07:03:19,487 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2/2e40834bfc014aa88fe1b694b2199d30 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2/2e40834bfc014aa88fe1b694b2199d30 2023-02-08 07:03:19,489 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2/aec4df1341dc4cd0962f9020d7cf5f27 to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/f2/aec4df1341dc4cd0962f9020d7cf5f27 2023-02-08 07:03:19,490 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/recovered.edits/6.seqid to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0/recovered.edits/6.seqid 2023-02-08 07:03:19,490 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/b90e49fec73de744aae2309c072367e0 2023-02-08 07:03:19,492 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/recovered.edits/12.seqid to hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/archive/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da/recovered.edits/12.seqid 2023-02-08 07:03:19,492 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/.tmp/data/default/testWithMockedMapReduceMultiRegion/941a8a477ea07d4f8905b62789d933da 2023-02-08 07:03:19,492 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-08 07:03:19,494 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:19,497 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-08 07:03:19,500 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-08 07:03:19,501 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:19,501 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-08 07:03:19,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839799501"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:19,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839799501"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:19,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675839795507.84049d23f1836ed1456960a4993876e6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839799501"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:19,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839799501"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:19,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839799501"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:19,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839799501"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:19,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839799501"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:19,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839799501"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:19,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839799501"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:19,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839799501"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:19,503 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-08 07:03:19,503 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bd93a30a19626092a69882fcdac58e23, NAME => 'testWithMockedMapReduceMultiRegion,,1675839795507.bd93a30a19626092a69882fcdac58e23.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => ef8f74b75cb8a75fb50619be90b2fdca, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675839795507.ef8f74b75cb8a75fb50619be90b2fdca.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 84049d23f1836ed1456960a4993876e6, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675839795507.84049d23f1836ed1456960a4993876e6.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 26575cad1b966bdf12197b7268a90ea9, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675839795507.26575cad1b966bdf12197b7268a90ea9.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 4801b4e0c43dd2e3ec7a967389c4b183, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675839795507.4801b4e0c43dd2e3ec7a967389c4b183.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 88b0ea7c06e199f4ac7f9f7b48dd93f3, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675839795507.88b0ea7c06e199f4ac7f9f7b48dd93f3.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => c344d75b5acd95336c6451dc11c34e23, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675839795507.c344d75b5acd95336c6451dc11c34e23.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 52d462aa8eb46c1b3d5399c511d8a9bf, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675839795507.52d462aa8eb46c1b3d5399c511d8a9bf.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 941a8a477ea07d4f8905b62789d933da, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675839795507.941a8a477ea07d4f8905b62789d933da.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => b90e49fec73de744aae2309c072367e0, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675839795507.b90e49fec73de744aae2309c072367e0.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-08 07:03:19,503 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-08 07:03:19,503 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675839799503"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:19,505 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-08 07:03:19,507 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 07:03:19,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 73 msec 2023-02-08 07:03:19,538 INFO [Listener at localhost/35563] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:19,538 INFO [Listener at localhost/35563] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:19,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-08 07:03:19,539 INFO [Listener at localhost/35563] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-08 07:03:19,539 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 07:03:19,539 INFO [Listener at localhost/35563] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 07:03:19,540 DEBUG [Listener at localhost/35563] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25711d63 to 127.0.0.1:60124 2023-02-08 07:03:19,540 DEBUG [Listener at localhost/35563] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:19,540 DEBUG [Listener at localhost/35563] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 07:03:19,540 DEBUG [Listener at localhost/35563] util.JVMClusterUtil(257): Found active master hash=4955682, stopped=false 2023-02-08 07:03:19,540 INFO [Listener at localhost/35563] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43147,1675839794190 2023-02-08 07:03:19,543 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:19,543 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:19,544 INFO [Listener at localhost/35563] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 07:03:19,543 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:19,544 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:19,545 DEBUG [Listener at localhost/35563] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x681b923c to 127.0.0.1:60124 2023-02-08 07:03:19,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:19,545 DEBUG [Listener at localhost/35563] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:19,545 INFO [Listener at localhost/35563] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35101,1675839794238' ***** 2023-02-08 07:03:19,546 INFO [Listener at localhost/35563] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:03:19,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:19,546 INFO [Listener at localhost/35563] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43331,1675839794266' ***** 2023-02-08 07:03:19,546 INFO [Listener at localhost/35563] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:03:19,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:19,546 INFO [RS:0;jenkins-hbase4:35101] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:03:19,546 INFO [RS:1;jenkins-hbase4:43331] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:03:19,546 INFO [RS:0;jenkins-hbase4:35101] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:03:19,546 INFO [RS:0;jenkins-hbase4:35101] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:03:19,546 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:03:19,546 INFO [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(3304): Received CLOSE for c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:19,546 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:03:19,547 INFO [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:19,546 INFO [RS:1;jenkins-hbase4:43331] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:03:19,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c871baa28df9de81a06c856049d02e24, disabling compactions & flushes 2023-02-08 07:03:19,548 DEBUG [RS:0;jenkins-hbase4:35101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67dd27a3 to 127.0.0.1:60124 2023-02-08 07:03:19,547 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:19,549 DEBUG [RS:0;jenkins-hbase4:35101] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:19,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. 2023-02-08 07:03:19,549 INFO [RS:1;jenkins-hbase4:43331] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:03:19,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. 2023-02-08 07:03:19,550 INFO [RS:1;jenkins-hbase4:43331] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:19,549 INFO [RS:0;jenkins-hbase4:35101] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:03:19,550 DEBUG [RS:1;jenkins-hbase4:43331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13e529f9 to 127.0.0.1:60124 2023-02-08 07:03:19,549 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:19,550 DEBUG [RS:1;jenkins-hbase4:43331] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:19,550 INFO [RS:0;jenkins-hbase4:35101] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:03:19,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. after waiting 0 ms 2023-02-08 07:03:19,550 INFO [RS:0;jenkins-hbase4:35101] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:03:19,550 INFO [RS:1;jenkins-hbase4:43331] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43331,1675839794266; all regions closed. 2023-02-08 07:03:19,551 INFO [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 07:03:19,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. 2023-02-08 07:03:19,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c871baa28df9de81a06c856049d02e24 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 07:03:19,551 INFO [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-08 07:03:19,551 DEBUG [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, c871baa28df9de81a06c856049d02e24=hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24.} 2023-02-08 07:03:19,551 DEBUG [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1505): Waiting on 1588230740, c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:19,553 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:03:19,553 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:03:19,553 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:03:19,553 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:03:19,553 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:03:19,553 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-08 07:03:19,557 DEBUG [RS:1;jenkins-hbase4:43331] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/oldWALs 2023-02-08 07:03:19,557 INFO [RS:1;jenkins-hbase4:43331] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43331%2C1675839794266:(num 1675839795568) 2023-02-08 07:03:19,557 DEBUG [RS:1;jenkins-hbase4:43331] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:19,557 INFO [RS:1;jenkins-hbase4:43331] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:19,558 INFO [RS:1;jenkins-hbase4:43331] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 07:03:19,558 INFO [RS:1;jenkins-hbase4:43331] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:03:19,558 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:19,558 INFO [RS:1;jenkins-hbase4:43331] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:03:19,558 INFO [RS:1;jenkins-hbase4:43331] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:03:19,559 INFO [RS:1;jenkins-hbase4:43331] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43331 2023-02-08 07:03:19,561 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:19,561 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:19,562 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:19,562 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43331,1675839794266 2023-02-08 07:03:19,562 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:19,569 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43331,1675839794266] 2023-02-08 07:03:19,570 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43331,1675839794266; numProcessing=1 2023-02-08 07:03:19,571 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43331,1675839794266 already deleted, retry=false 2023-02-08 07:03:19,571 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43331,1675839794266 expired; onlineServers=1 2023-02-08 07:03:19,573 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/.tmp/info/9343924dd3e045e699b9e72a12e16de3 2023-02-08 07:03:19,576 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9343924dd3e045e699b9e72a12e16de3 2023-02-08 07:03:19,582 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/.tmp/rep_barrier/e62498864f7a45c18e05236a30cab4ce 2023-02-08 07:03:19,585 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e62498864f7a45c18e05236a30cab4ce 2023-02-08 07:03:19,596 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/.tmp/table/e9c733b97d92460c9722a2cf9bc1257d 2023-02-08 07:03:19,600 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9c733b97d92460c9722a2cf9bc1257d 2023-02-08 07:03:19,601 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/.tmp/info/9343924dd3e045e699b9e72a12e16de3 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/info/9343924dd3e045e699b9e72a12e16de3 2023-02-08 07:03:19,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9343924dd3e045e699b9e72a12e16de3 2023-02-08 07:03:19,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/info/9343924dd3e045e699b9e72a12e16de3, entries=30, sequenceid=57, filesize=8.3 K 2023-02-08 07:03:19,606 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/.tmp/rep_barrier/e62498864f7a45c18e05236a30cab4ce as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/rep_barrier/e62498864f7a45c18e05236a30cab4ce 2023-02-08 07:03:19,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e62498864f7a45c18e05236a30cab4ce 2023-02-08 07:03:19,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/rep_barrier/e62498864f7a45c18e05236a30cab4ce, entries=10, sequenceid=57, filesize=6.1 K 2023-02-08 07:03:19,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/.tmp/table/e9c733b97d92460c9722a2cf9bc1257d as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/table/e9c733b97d92460c9722a2cf9bc1257d 2023-02-08 07:03:19,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9c733b97d92460c9722a2cf9bc1257d 2023-02-08 07:03:19,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/table/e9c733b97d92460c9722a2cf9bc1257d, entries=13, sequenceid=57, filesize=6.1 K 2023-02-08 07:03:19,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 63ms, sequenceid=57, compaction requested=false 2023-02-08 07:03:19,627 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-08 07:03:19,627 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 07:03:19,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:19,628 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839799551Running coprocessor pre-close hooks at 1675839799551Disabling compacts and flushes for region at 1675839799551Disabling writes for close at 1675839799553 (+2 ms)Obtaining lock to block concurrent updates at 1675839799553Preparing flush snapshotting stores in 1588230740 at 1675839799553Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1675839799553Flushing stores of hbase:meta,,1.1588230740 at 1675839799554 (+1 ms)Flushing 1588230740/info: creating writer at 1675839799555 (+1 ms)Flushing 1588230740/info: appending metadata at 1675839799557 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675839799557Flushing 1588230740/rep_barrier: creating writer at 1675839799576 (+19 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675839799578 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675839799578Flushing 1588230740/table: creating writer at 1675839799586 (+8 ms)Flushing 1588230740/table: appending metadata at 1675839799587 (+1 ms)Flushing 1588230740/table: closing flushed file at 1675839799588 (+1 ms)Flushing 1588230740/info: reopening flushed file at 1675839799602 (+14 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675839799607 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675839799611 (+4 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 63ms, sequenceid=57, compaction requested=false at 1675839799616 (+5 ms)Writing region close event to WAL at 1675839799624 (+8 ms)Running coprocessor post-close hooks at 1675839799627 (+3 ms)Closed at 1675839799628 (+1 ms) 2023-02-08 07:03:19,628 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:19,744 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:19,744 INFO [RS:1;jenkins-hbase4:43331] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43331,1675839794266; zookeeper connection closed. 2023-02-08 07:03:19,744 ERROR [Listener at localhost/35563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@483562e8 rejected from java.util.concurrent.ThreadPoolExecutor@4c0aff36[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:19,744 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:43331-0x10032bdd5bf0002, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:19,744 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5999501b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5999501b 2023-02-08 07:03:19,744 ERROR [Listener at localhost/35563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b8a8d10 rejected from java.util.concurrent.ThreadPoolExecutor@4c0aff36[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:19,753 DEBUG [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1505): Waiting on c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:19,953 DEBUG [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1505): Waiting on c871baa28df9de81a06c856049d02e24 2023-02-08 07:03:19,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/namespace/c871baa28df9de81a06c856049d02e24/.tmp/info/9363d23ed76b4dc88a78714a7827c57b 2023-02-08 07:03:19,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/namespace/c871baa28df9de81a06c856049d02e24/.tmp/info/9363d23ed76b4dc88a78714a7827c57b as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/namespace/c871baa28df9de81a06c856049d02e24/info/9363d23ed76b4dc88a78714a7827c57b 2023-02-08 07:03:19,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/namespace/c871baa28df9de81a06c856049d02e24/info/9363d23ed76b4dc88a78714a7827c57b, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 07:03:19,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c871baa28df9de81a06c856049d02e24 in 431ms, sequenceid=6, compaction requested=false 2023-02-08 07:03:19,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/data/hbase/namespace/c871baa28df9de81a06c856049d02e24/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 07:03:19,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. 2023-02-08 07:03:19,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c871baa28df9de81a06c856049d02e24: Waiting for close lock at 1675839799548Running coprocessor pre-close hooks at 1675839799548Disabling compacts and flushes for region at 1675839799548Disabling writes for close at 1675839799551 (+3 ms)Obtaining lock to block concurrent updates at 1675839799551Preparing flush snapshotting stores in c871baa28df9de81a06c856049d02e24 at 1675839799551Finished memstore snapshotting hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675839799553 (+2 ms)Flushing stores of hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. at 1675839799553Flushing c871baa28df9de81a06c856049d02e24/info: creating writer at 1675839799553Flushing c871baa28df9de81a06c856049d02e24/info: appending metadata at 1675839799557 (+4 ms)Flushing c871baa28df9de81a06c856049d02e24/info: closing flushed file at 1675839799557Flushing c871baa28df9de81a06c856049d02e24/info: reopening flushed file at 1675839799978 (+421 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c871baa28df9de81a06c856049d02e24 in 431ms, sequenceid=6, compaction requested=false at 1675839799982 (+4 ms)Writing region close event to WAL at 1675839799983 (+1 ms)Running coprocessor post-close hooks at 1675839799985 (+2 ms)Closed at 1675839799986 (+1 ms) 2023-02-08 07:03:19,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675839794848.c871baa28df9de81a06c856049d02e24. 2023-02-08 07:03:20,153 INFO [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35101,1675839794238; all regions closed. 2023-02-08 07:03:20,162 DEBUG [RS:0;jenkins-hbase4:35101] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/oldWALs 2023-02-08 07:03:20,162 INFO [RS:0;jenkins-hbase4:35101] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35101%2C1675839794238.meta:.meta(num 1675839794786) 2023-02-08 07:03:20,166 DEBUG [RS:0;jenkins-hbase4:35101] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/oldWALs 2023-02-08 07:03:20,166 INFO [RS:0;jenkins-hbase4:35101] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35101%2C1675839794238:(num 1675839795218) 2023-02-08 07:03:20,166 DEBUG [RS:0;jenkins-hbase4:35101] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:20,166 INFO [RS:0;jenkins-hbase4:35101] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:20,166 INFO [RS:0;jenkins-hbase4:35101] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 07:03:20,166 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:20,167 INFO [RS:0;jenkins-hbase4:35101] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35101 2023-02-08 07:03:20,169 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:20,169 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35101,1675839794238 2023-02-08 07:03:20,169 ERROR [Listener at localhost/35563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@397ae50d rejected from java.util.concurrent.ThreadPoolExecutor@3d4576fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:20,170 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35101,1675839794238] 2023-02-08 07:03:20,170 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35101,1675839794238; numProcessing=2 2023-02-08 07:03:20,171 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35101,1675839794238 already deleted, retry=false 2023-02-08 07:03:20,171 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35101,1675839794238 expired; onlineServers=0 2023-02-08 07:03:20,171 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43147,1675839794190' ***** 2023-02-08 07:03:20,171 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 07:03:20,172 DEBUG [M:0;jenkins-hbase4:43147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4740af3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:20,172 INFO [M:0;jenkins-hbase4:43147] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43147,1675839794190 2023-02-08 07:03:20,172 INFO [M:0;jenkins-hbase4:43147] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43147,1675839794190; all regions closed. 2023-02-08 07:03:20,172 DEBUG [M:0;jenkins-hbase4:43147] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:20,172 DEBUG [M:0;jenkins-hbase4:43147] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 07:03:20,172 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 07:03:20,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839794425] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839794425,5,FailOnTimeoutGroup] 2023-02-08 07:03:20,172 DEBUG [M:0;jenkins-hbase4:43147] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 07:03:20,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839794426] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839794426,5,FailOnTimeoutGroup] 2023-02-08 07:03:20,173 INFO [M:0;jenkins-hbase4:43147] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 07:03:20,174 INFO [M:0;jenkins-hbase4:43147] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 07:03:20,174 INFO [M:0;jenkins-hbase4:43147] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 07:03:20,174 DEBUG [M:0;jenkins-hbase4:43147] master.HMaster(1502): Stopping service threads 2023-02-08 07:03:20,174 INFO [M:0;jenkins-hbase4:43147] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 07:03:20,174 ERROR [M:0;jenkins-hbase4:43147] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-08 07:03:20,174 INFO [M:0;jenkins-hbase4:43147] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 07:03:20,175 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 07:03:20,175 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:20,175 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:20,175 DEBUG [M:0;jenkins-hbase4:43147] zookeeper.ZKUtil(398): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 07:03:20,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:20,175 WARN [M:0;jenkins-hbase4:43147] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 07:03:20,175 INFO [M:0;jenkins-hbase4:43147] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 07:03:20,176 INFO [M:0;jenkins-hbase4:43147] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 07:03:20,176 DEBUG [M:0;jenkins-hbase4:43147] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:03:20,176 INFO [M:0;jenkins-hbase4:43147] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:20,176 DEBUG [M:0;jenkins-hbase4:43147] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:20,176 DEBUG [M:0;jenkins-hbase4:43147] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:03:20,176 DEBUG [M:0;jenkins-hbase4:43147] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:20,176 INFO [M:0;jenkins-hbase4:43147] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.14 KB heapSize=200.04 KB 2023-02-08 07:03:20,184 INFO [M:0;jenkins-hbase4:43147] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.14 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3edaa791ce144ba88377e8cb6f6b1128 2023-02-08 07:03:20,188 DEBUG [M:0;jenkins-hbase4:43147] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3edaa791ce144ba88377e8cb6f6b1128 as hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3edaa791ce144ba88377e8cb6f6b1128 2023-02-08 07:03:20,192 INFO [M:0;jenkins-hbase4:43147] regionserver.HStore(1080): Added hdfs://localhost:44939/user/jenkins/test-data/be00216f-592f-d173-6dc7-51dd2d036871/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3edaa791ce144ba88377e8cb6f6b1128, entries=53, sequenceid=357, filesize=10.7 K 2023-02-08 07:03:20,193 INFO [M:0;jenkins-hbase4:43147] regionserver.HRegion(2947): Finished flush of dataSize ~167.14 KB/171153, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false 2023-02-08 07:03:20,193 INFO [M:0;jenkins-hbase4:43147] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:20,194 DEBUG [M:0;jenkins-hbase4:43147] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839800176Disabling compacts and flushes for region at 1675839800176Disabling writes for close at 1675839800176Obtaining lock to block concurrent updates at 1675839800176Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675839800176Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171153, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1675839800176Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675839800177 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675839800177Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675839800179 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675839800179Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675839800189 (+10 ms)Finished flush of dataSize ~167.14 KB/171153, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false at 1675839800193 (+4 ms)Writing region close event to WAL at 1675839800193Closed at 1675839800193 2023-02-08 07:03:20,196 INFO [M:0;jenkins-hbase4:43147] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 07:03:20,196 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:20,197 INFO [M:0;jenkins-hbase4:43147] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43147 2023-02-08 07:03:20,200 DEBUG [M:0;jenkins-hbase4:43147] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43147,1675839794190 already deleted, retry=false 2023-02-08 07:03:20,270 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:20,270 INFO [RS:0;jenkins-hbase4:35101] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35101,1675839794238; zookeeper connection closed. 2023-02-08 07:03:20,271 ERROR [Listener at localhost/35563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27c9ecf9 rejected from java.util.concurrent.ThreadPoolExecutor@3d4576fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:20,271 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): regionserver:35101-0x10032bdd5bf0001, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:20,271 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@63a48515] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@63a48515 2023-02-08 07:03:20,271 ERROR [Listener at localhost/35563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5f916ae2 rejected from java.util.concurrent.ThreadPoolExecutor@3d4576fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:20,271 INFO [Listener at localhost/35563] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 07:03:20,311 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-08 07:03:20,371 INFO [M:0;jenkins-hbase4:43147] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43147,1675839794190; zookeeper connection closed. 2023-02-08 07:03:20,371 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:20,372 ERROR [Listener at localhost/35563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@226e8a7 rejected from java.util.concurrent.ThreadPoolExecutor@6197c3b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:20,372 WARN [Listener at localhost/35563] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:03:20,372 DEBUG [Listener at localhost/35563-EventThread] zookeeper.ZKWatcher(600): master:43147-0x10032bdd5bf0000, quorum=127.0.0.1:60124, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:20,372 ERROR [Listener at localhost/35563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4744eefb rejected from java.util.concurrent.ThreadPoolExecutor@6197c3b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:20,376 INFO [Listener at localhost/35563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:20,484 WARN [BP-1480324387-172.31.14.131-1675839793615 heartbeating to localhost/127.0.0.1:44939] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:03:20,484 WARN [BP-1480324387-172.31.14.131-1675839793615 heartbeating to localhost/127.0.0.1:44939] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1480324387-172.31.14.131-1675839793615 (Datanode Uuid 73dfd131-0a78-4f90-adb8-4334f33bb4b8) service to localhost/127.0.0.1:44939 2023-02-08 07:03:20,485 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/cluster_cc838893-e0fd-b676-e465-f73d7417b71a/dfs/data/data3/current/BP-1480324387-172.31.14.131-1675839793615] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:20,485 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/cluster_cc838893-e0fd-b676-e465-f73d7417b71a/dfs/data/data4/current/BP-1480324387-172.31.14.131-1675839793615] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:20,487 WARN [Listener at localhost/35563] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:03:20,489 INFO [Listener at localhost/35563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:20,598 WARN [BP-1480324387-172.31.14.131-1675839793615 heartbeating to localhost/127.0.0.1:44939] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:03:20,600 WARN [BP-1480324387-172.31.14.131-1675839793615 heartbeating to localhost/127.0.0.1:44939] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1480324387-172.31.14.131-1675839793615 (Datanode Uuid c7a5e39e-6a6f-4b83-8213-5399f409785c) service to localhost/127.0.0.1:44939 2023-02-08 07:03:20,601 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/cluster_cc838893-e0fd-b676-e465-f73d7417b71a/dfs/data/data1/current/BP-1480324387-172.31.14.131-1675839793615] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:20,601 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/cluster_cc838893-e0fd-b676-e465-f73d7417b71a/dfs/data/data2/current/BP-1480324387-172.31.14.131-1675839793615] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:20,611 INFO [Listener at localhost/35563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:20,730 INFO [Listener at localhost/35563] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 07:03:20,765 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 07:03:20,780 INFO [Listener at localhost/35563] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=231 (was 180) Potentially hanging thread: (jenkins-hbase4.apache.org,43147,1675839794190)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/35563 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:44939 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/35563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44939 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/35563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:44939 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:44939 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/35563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:44939 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:44939 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:44939 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=646 (was 565) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=275 (was 290), ProcessCount=165 (was 165), AvailableMemoryMB=4281 (was 4338) 2023-02-08 07:03:20,789 INFO [Listener at localhost/35563] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=231, OpenFileDescriptor=646, MaxFileDescriptor=60000, SystemLoadAverage=275, ProcessCount=165, AvailableMemoryMB=4280 2023-02-08 07:03:20,799 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/hadoop.log.dir so I do NOT create it in target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c 2023-02-08 07:03:20,800 WARN [Listener at localhost/35563] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/hadoop.log.dir Erasing configuration value by system value. 2023-02-08 07:03:20,800 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/hadoop.tmp.dir so I do NOT create it in target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c 2023-02-08 07:03:20,800 WARN [Listener at localhost/35563] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/629636c7-bcd3-6aa2-c7fa-f36d2441eba2/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-08 07:03:20,800 DEBUG [Listener at localhost/35563] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c 2023-02-08 07:03:20,800 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 07:03:20,800 INFO [Listener at localhost/35563] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/cluster_ba76cba8-4982-26c9-8f4f-6a37dcffc244, deleteOnExit=true 2023-02-08 07:03:20,800 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 07:03:20,800 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/test.cache.data in system properties and HBase conf 2023-02-08 07:03:20,800 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 07:03:20,800 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/hadoop.log.dir in system properties and HBase conf 2023-02-08 07:03:20,800 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 07:03:20,800 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 07:03:20,801 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 07:03:20,801 DEBUG [Listener at localhost/35563] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 07:03:20,801 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:03:20,801 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:03:20,801 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 07:03:20,801 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:03:20,801 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 07:03:20,801 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 07:03:20,801 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:03:20,801 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:03:20,802 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 07:03:20,802 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/nfs.dump.dir in system properties and HBase conf 2023-02-08 07:03:20,802 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/java.io.tmpdir in system properties and HBase conf 2023-02-08 07:03:20,802 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:03:20,802 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 07:03:20,802 INFO [Listener at localhost/35563] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 07:03:20,806 WARN [Listener at localhost/35563] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:03:20,806 WARN [Listener at localhost/35563] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:03:20,844 WARN [Listener at localhost/35563] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:20,846 INFO [Listener at localhost/35563] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:20,852 INFO [Listener at localhost/35563] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/java.io.tmpdir/Jetty_localhost_38179_hdfs____t41ypk/webapp 2023-02-08 07:03:20,944 INFO [Listener at localhost/35563] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38179 2023-02-08 07:03:20,949 WARN [Listener at localhost/35563] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:03:20,949 WARN [Listener at localhost/35563] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:03:20,988 WARN [Listener at localhost/45671] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:21,009 WARN [Listener at localhost/45671] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:03:21,011 WARN [Listener at localhost/45671] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:21,012 INFO [Listener at localhost/45671] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:21,016 INFO [Listener at localhost/45671] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/java.io.tmpdir/Jetty_localhost_45961_datanode____.1rn1mu/webapp 2023-02-08 07:03:21,111 INFO [Listener at localhost/45671] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45961 2023-02-08 07:03:21,124 WARN [Listener at localhost/36919] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:21,142 WARN [Listener at localhost/36919] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:03:21,144 WARN [Listener at localhost/36919] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:21,145 INFO [Listener at localhost/36919] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:21,148 INFO [Listener at localhost/36919] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/java.io.tmpdir/Jetty_localhost_46269_datanode____.agn10m/webapp 2023-02-08 07:03:21,221 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x23ab7071906d3d02: Processing first storage report for DS-ade423d1-ceea-4699-8c23-2d8c67b60585 from datanode 13a30156-d171-4b0a-a198-c77c2e7c7c67 2023-02-08 07:03:21,222 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x23ab7071906d3d02: from storage DS-ade423d1-ceea-4699-8c23-2d8c67b60585 node DatanodeRegistration(127.0.0.1:34357, datanodeUuid=13a30156-d171-4b0a-a198-c77c2e7c7c67, infoPort=35865, infoSecurePort=0, ipcPort=36919, storageInfo=lv=-57;cid=testClusterID;nsid=1735597400;c=1675839800809), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:21,222 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x23ab7071906d3d02: Processing first storage report for DS-4beab772-d83f-42c1-9235-551a3f824a58 from datanode 13a30156-d171-4b0a-a198-c77c2e7c7c67 2023-02-08 07:03:21,222 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x23ab7071906d3d02: from storage DS-4beab772-d83f-42c1-9235-551a3f824a58 node DatanodeRegistration(127.0.0.1:34357, datanodeUuid=13a30156-d171-4b0a-a198-c77c2e7c7c67, infoPort=35865, infoSecurePort=0, ipcPort=36919, storageInfo=lv=-57;cid=testClusterID;nsid=1735597400;c=1675839800809), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:21,256 INFO [Listener at localhost/36919] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46269 2023-02-08 07:03:21,264 WARN [Listener at localhost/41689] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:21,358 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9106e4690312d21f: Processing first storage report for DS-1e104cb0-572b-447f-abe1-1df65aee9208 from datanode 1f28765a-f8ae-4d8c-9805-ab6c87061fdf 2023-02-08 07:03:21,358 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9106e4690312d21f: from storage DS-1e104cb0-572b-447f-abe1-1df65aee9208 node DatanodeRegistration(127.0.0.1:40973, datanodeUuid=1f28765a-f8ae-4d8c-9805-ab6c87061fdf, infoPort=40145, infoSecurePort=0, ipcPort=41689, storageInfo=lv=-57;cid=testClusterID;nsid=1735597400;c=1675839800809), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:21,358 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9106e4690312d21f: Processing first storage report for DS-d677bc3b-45d0-4012-87e0-b91865394c76 from datanode 1f28765a-f8ae-4d8c-9805-ab6c87061fdf 2023-02-08 07:03:21,358 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9106e4690312d21f: from storage DS-d677bc3b-45d0-4012-87e0-b91865394c76 node DatanodeRegistration(127.0.0.1:40973, datanodeUuid=1f28765a-f8ae-4d8c-9805-ab6c87061fdf, infoPort=40145, infoSecurePort=0, ipcPort=41689, storageInfo=lv=-57;cid=testClusterID;nsid=1735597400;c=1675839800809), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:21,371 DEBUG [Listener at localhost/41689] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c 2023-02-08 07:03:21,373 INFO [Listener at localhost/41689] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/cluster_ba76cba8-4982-26c9-8f4f-6a37dcffc244/zookeeper_0, clientPort=51950, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/cluster_ba76cba8-4982-26c9-8f4f-6a37dcffc244/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/cluster_ba76cba8-4982-26c9-8f4f-6a37dcffc244/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 07:03:21,374 INFO [Listener at localhost/41689] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51950 2023-02-08 07:03:21,374 INFO [Listener at localhost/41689] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:21,375 INFO [Listener at localhost/41689] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:21,389 INFO [Listener at localhost/41689] util.FSUtils(479): Created version file at hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b with version=8 2023-02-08 07:03:21,390 INFO [Listener at localhost/41689] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:21,391 INFO [Listener at localhost/41689] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:21,392 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45671/user/jenkins/test-data/4c27c03a-80b5-d9e2-33eb-de300e5cf595/hbase-staging 2023-02-08 07:03:21,394 INFO [Listener at localhost/41689] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:21,394 INFO [Listener at localhost/41689] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:21,394 INFO [Listener at localhost/41689] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:21,395 INFO [Listener at localhost/41689] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:21,395 INFO [Listener at localhost/41689] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:21,395 INFO [Listener at localhost/41689] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:21,395 INFO [Listener at localhost/41689] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:21,396 INFO [Listener at localhost/41689] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37609 2023-02-08 07:03:21,396 INFO [Listener at localhost/41689] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:21,397 INFO [Listener at localhost/41689] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:21,399 INFO [Listener at localhost/41689] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37609 connecting to ZooKeeper ensemble=127.0.0.1:51950 2023-02-08 07:03:21,406 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:376090x0, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:21,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37609-0x10032bdf1e10000 connected 2023-02-08 07:03:21,425 DEBUG [Listener at localhost/41689] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:21,425 DEBUG [Listener at localhost/41689] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:21,425 DEBUG [Listener at localhost/41689] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:21,426 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37609 2023-02-08 07:03:21,429 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37609 2023-02-08 07:03:21,432 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37609 2023-02-08 07:03:21,432 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37609 2023-02-08 07:03:21,432 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37609 2023-02-08 07:03:21,432 INFO [Listener at localhost/41689] master.HMaster(439): hbase.rootdir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b, hbase.cluster.distributed=false 2023-02-08 07:03:21,444 INFO [Listener at localhost/41689] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:21,444 INFO [Listener at localhost/41689] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:21,444 INFO [Listener at localhost/41689] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:21,444 INFO [Listener at localhost/41689] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:21,444 INFO [Listener at localhost/41689] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:21,444 INFO [Listener at localhost/41689] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:21,445 INFO [Listener at localhost/41689] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:21,445 INFO [Listener at localhost/41689] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32827 2023-02-08 07:03:21,445 INFO [Listener at localhost/41689] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:03:21,448 DEBUG [Listener at localhost/41689] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:21,448 INFO [Listener at localhost/41689] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:21,449 INFO [Listener at localhost/41689] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:21,450 INFO [Listener at localhost/41689] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32827 connecting to ZooKeeper ensemble=127.0.0.1:51950 2023-02-08 07:03:21,453 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:328270x0, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:21,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:32827-0x10032bdf1e10001 connected 2023-02-08 07:03:21,454 DEBUG [Listener at localhost/41689] zookeeper.ZKUtil(164): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:21,455 DEBUG [Listener at localhost/41689] zookeeper.ZKUtil(164): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:21,455 DEBUG [Listener at localhost/41689] zookeeper.ZKUtil(164): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:21,456 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32827 2023-02-08 07:03:21,457 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32827 2023-02-08 07:03:21,458 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32827 2023-02-08 07:03:21,459 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32827 2023-02-08 07:03:21,459 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32827 2023-02-08 07:03:21,469 INFO [Listener at localhost/41689] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:21,469 INFO [Listener at localhost/41689] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:21,470 INFO [Listener at localhost/41689] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:21,470 INFO [Listener at localhost/41689] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:21,470 INFO [Listener at localhost/41689] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:21,470 INFO [Listener at localhost/41689] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:21,470 INFO [Listener at localhost/41689] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:21,471 INFO [Listener at localhost/41689] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38533 2023-02-08 07:03:21,471 INFO [Listener at localhost/41689] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:03:21,471 DEBUG [Listener at localhost/41689] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:21,472 INFO [Listener at localhost/41689] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:21,473 INFO [Listener at localhost/41689] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:21,474 INFO [Listener at localhost/41689] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38533 connecting to ZooKeeper ensemble=127.0.0.1:51950 2023-02-08 07:03:21,478 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:385330x0, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:21,479 DEBUG [Listener at localhost/41689] zookeeper.ZKUtil(164): regionserver:385330x0, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:21,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38533-0x10032bdf1e10002 connected 2023-02-08 07:03:21,480 DEBUG [Listener at localhost/41689] zookeeper.ZKUtil(164): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:21,481 DEBUG [Listener at localhost/41689] zookeeper.ZKUtil(164): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:21,484 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38533 2023-02-08 07:03:21,484 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38533 2023-02-08 07:03:21,486 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38533 2023-02-08 07:03:21,486 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38533 2023-02-08 07:03:21,486 DEBUG [Listener at localhost/41689] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38533 2023-02-08 07:03:21,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37609,1675839801394 2023-02-08 07:03:21,490 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:03:21,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37609,1675839801394 2023-02-08 07:03:21,491 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:21,491 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:21,491 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:21,492 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:21,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:03:21,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37609,1675839801394 from backup master directory 2023-02-08 07:03:21,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:03:21,496 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37609,1675839801394 2023-02-08 07:03:21,496 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:03:21,496 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:21,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37609,1675839801394 2023-02-08 07:03:21,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/hbase.id with ID: 013c42e7-cf44-4057-8957-fb0e687400b3 2023-02-08 07:03:21,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:21,524 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:21,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x167008b6 to 127.0.0.1:51950 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:21,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4662c6ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:21,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:21,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 07:03:21,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:21,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/data/master/store-tmp 2023-02-08 07:03:21,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:21,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:03:21,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:21,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:21,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:03:21,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:21,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:21,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839801545Disabling compacts and flushes for region at 1675839801545Disabling writes for close at 1675839801545Writing region close event to WAL at 1675839801545Closed at 1675839801545 2023-02-08 07:03:21,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/WALs/jenkins-hbase4.apache.org,37609,1675839801394 2023-02-08 07:03:21,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37609%2C1675839801394, suffix=, logDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/WALs/jenkins-hbase4.apache.org,37609,1675839801394, archiveDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/oldWALs, maxLogs=10 2023-02-08 07:03:21,562 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40973,DS-1e104cb0-572b-447f-abe1-1df65aee9208,DISK] 2023-02-08 07:03:21,562 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34357,DS-ade423d1-ceea-4699-8c23-2d8c67b60585,DISK] 2023-02-08 07:03:21,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/WALs/jenkins-hbase4.apache.org,37609,1675839801394/jenkins-hbase4.apache.org%2C37609%2C1675839801394.1675839801548 2023-02-08 07:03:21,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40973,DS-1e104cb0-572b-447f-abe1-1df65aee9208,DISK], DatanodeInfoWithStorage[127.0.0.1:34357,DS-ade423d1-ceea-4699-8c23-2d8c67b60585,DISK]] 2023-02-08 07:03:21,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:21,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:21,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:21,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:21,565 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:21,566 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 07:03:21,567 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 07:03:21,567 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:21,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:21,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:21,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:21,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:21,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71518585, jitterRate=0.06570996344089508}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:03:21,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675839801565Initializing all the Stores at 1675839801565Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839801565Cleaning up temporary data from old regions at 1675839801568 (+3 ms)Cleaning up detritus from prior splits at 1675839801569 (+1 ms)Region opened successfully at 1675839801571 (+2 ms) 2023-02-08 07:03:21,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 07:03:21,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 07:03:21,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 07:03:21,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 07:03:21,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-08 07:03:21,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-08 07:03:21,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 07:03:21,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 07:03:21,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 07:03:21,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 07:03:21,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 07:03:21,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 07:03:21,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 07:03:21,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 07:03:21,587 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:21,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 07:03:21,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 07:03:21,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 07:03:21,590 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:21,590 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:21,590 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:21,590 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:21,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37609,1675839801394, sessionid=0x10032bdf1e10000, setting cluster-up flag (Was=false) 2023-02-08 07:03:21,595 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:21,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 07:03:21,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37609,1675839801394 2023-02-08 07:03:21,602 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:21,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 07:03:21,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37609,1675839801394 2023-02-08 07:03:21,608 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.hbase-snapshot/.tmp 2023-02-08 07:03:21,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:21,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:21,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:21,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:21,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:21,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 07:03:21,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:21,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675839831611 2023-02-08 07:03:21,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 07:03:21,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 07:03:21,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 07:03:21,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 07:03:21,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 07:03:21,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 07:03:21,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,612 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:21,612 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 07:03:21,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 07:03:21,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 07:03:21,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 07:03:21,613 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:21,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 07:03:21,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 07:03:21,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839801615,5,FailOnTimeoutGroup] 2023-02-08 07:03:21,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839801615,5,FailOnTimeoutGroup] 2023-02-08 07:03:21,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 07:03:21,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,623 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:21,623 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:21,623 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b 2023-02-08 07:03:21,690 INFO [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(952): ClusterId : 013c42e7-cf44-4057-8957-fb0e687400b3 2023-02-08 07:03:21,690 INFO [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(952): ClusterId : 013c42e7-cf44-4057-8957-fb0e687400b3 2023-02-08 07:03:21,690 DEBUG [RS:0;jenkins-hbase4:32827] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:03:21,690 DEBUG [RS:1;jenkins-hbase4:38533] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:03:21,692 DEBUG [RS:0;jenkins-hbase4:32827] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:03:21,692 DEBUG [RS:0;jenkins-hbase4:32827] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:03:21,692 DEBUG [RS:1;jenkins-hbase4:38533] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:03:21,692 DEBUG [RS:1;jenkins-hbase4:38533] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:03:21,695 DEBUG [RS:0;jenkins-hbase4:32827] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:03:21,696 DEBUG [RS:1;jenkins-hbase4:38533] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:03:21,696 DEBUG [RS:0;jenkins-hbase4:32827] zookeeper.ReadOnlyZKClient(139): Connect 0x3565067e to 127.0.0.1:51950 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:21,697 DEBUG [RS:1;jenkins-hbase4:38533] zookeeper.ReadOnlyZKClient(139): Connect 0x7b0787eb to 127.0.0.1:51950 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:21,702 DEBUG [RS:0;jenkins-hbase4:32827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ba2eea2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:21,703 DEBUG [RS:1;jenkins-hbase4:38533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75c066fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:21,703 DEBUG [RS:0;jenkins-hbase4:32827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f9d6d0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:21,703 DEBUG [RS:1;jenkins-hbase4:38533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71ffec9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:21,711 DEBUG [RS:0;jenkins-hbase4:32827] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:32827 2023-02-08 07:03:21,711 DEBUG [RS:1;jenkins-hbase4:38533] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38533 2023-02-08 07:03:21,711 INFO [RS:0;jenkins-hbase4:32827] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:03:21,711 INFO [RS:0;jenkins-hbase4:32827] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:03:21,711 INFO [RS:1;jenkins-hbase4:38533] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:03:21,711 DEBUG [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:03:21,711 INFO [RS:1;jenkins-hbase4:38533] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:03:21,711 DEBUG [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:03:21,712 INFO [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37609,1675839801394 with isa=jenkins-hbase4.apache.org/172.31.14.131:38533, startcode=1675839801469 2023-02-08 07:03:21,712 INFO [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37609,1675839801394 with isa=jenkins-hbase4.apache.org/172.31.14.131:32827, startcode=1675839801444 2023-02-08 07:03:21,712 DEBUG [RS:1;jenkins-hbase4:38533] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:03:21,712 DEBUG [RS:0;jenkins-hbase4:32827] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:03:21,714 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56253, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:03:21,715 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34705, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:03:21,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37609] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:21,715 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:21,716 DEBUG [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b 2023-02-08 07:03:21,716 DEBUG [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45671 2023-02-08 07:03:21,716 DEBUG [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:03:21,716 DEBUG [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b 2023-02-08 07:03:21,716 DEBUG [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45671 2023-02-08 07:03:21,716 DEBUG [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:03:21,717 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:21,724 DEBUG [RS:1;jenkins-hbase4:38533] zookeeper.ZKUtil(162): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:21,724 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38533,1675839801469] 2023-02-08 07:03:21,724 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32827,1675839801444] 2023-02-08 07:03:21,724 WARN [RS:1;jenkins-hbase4:38533] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:21,724 DEBUG [RS:0;jenkins-hbase4:32827] zookeeper.ZKUtil(162): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:21,724 INFO [RS:1;jenkins-hbase4:38533] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:21,724 WARN [RS:0;jenkins-hbase4:32827] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:21,724 DEBUG [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/WALs/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:21,724 INFO [RS:0;jenkins-hbase4:32827] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:21,725 DEBUG [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/WALs/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:21,730 DEBUG [RS:1;jenkins-hbase4:38533] zookeeper.ZKUtil(162): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:21,730 DEBUG [RS:0;jenkins-hbase4:32827] zookeeper.ZKUtil(162): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:21,730 DEBUG [RS:1;jenkins-hbase4:38533] zookeeper.ZKUtil(162): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:21,730 DEBUG [RS:0;jenkins-hbase4:32827] zookeeper.ZKUtil(162): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:21,731 DEBUG [RS:1;jenkins-hbase4:38533] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:03:21,731 DEBUG [RS:0;jenkins-hbase4:32827] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:03:21,731 INFO [RS:1;jenkins-hbase4:38533] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:03:21,731 INFO [RS:0;jenkins-hbase4:32827] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:03:21,733 INFO [RS:1;jenkins-hbase4:38533] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:03:21,733 INFO [RS:1;jenkins-hbase4:38533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:03:21,733 INFO [RS:1;jenkins-hbase4:38533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,736 INFO [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:03:21,736 INFO [RS:0;jenkins-hbase4:32827] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:03:21,737 INFO [RS:0;jenkins-hbase4:32827] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:03:21,737 INFO [RS:0;jenkins-hbase4:32827] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,737 INFO [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:03:21,737 INFO [RS:1;jenkins-hbase4:38533] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,738 DEBUG [RS:1;jenkins-hbase4:38533] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,738 DEBUG [RS:1;jenkins-hbase4:38533] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,738 DEBUG [RS:1;jenkins-hbase4:38533] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,738 DEBUG [RS:1;jenkins-hbase4:38533] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,738 DEBUG [RS:1;jenkins-hbase4:38533] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,738 INFO [RS:0;jenkins-hbase4:32827] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,738 DEBUG [RS:1;jenkins-hbase4:38533] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:21,739 DEBUG [RS:0;jenkins-hbase4:32827] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,739 DEBUG [RS:1;jenkins-hbase4:38533] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,739 DEBUG [RS:0;jenkins-hbase4:32827] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,739 DEBUG [RS:1;jenkins-hbase4:38533] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,739 DEBUG [RS:0;jenkins-hbase4:32827] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,739 DEBUG [RS:1;jenkins-hbase4:38533] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,739 DEBUG [RS:0;jenkins-hbase4:32827] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,739 DEBUG [RS:1;jenkins-hbase4:38533] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,739 DEBUG [RS:0;jenkins-hbase4:32827] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,739 DEBUG [RS:0;jenkins-hbase4:32827] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:21,739 DEBUG [RS:0;jenkins-hbase4:32827] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,739 DEBUG [RS:0;jenkins-hbase4:32827] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,739 DEBUG [RS:0;jenkins-hbase4:32827] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,739 DEBUG [RS:0;jenkins-hbase4:32827] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:21,745 INFO [RS:0;jenkins-hbase4:32827] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,745 INFO [RS:0;jenkins-hbase4:32827] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,745 INFO [RS:1;jenkins-hbase4:38533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,745 INFO [RS:0;jenkins-hbase4:32827] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,745 INFO [RS:1;jenkins-hbase4:38533] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,746 INFO [RS:1;jenkins-hbase4:38533] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,757 INFO [RS:0;jenkins-hbase4:32827] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:03:21,757 INFO [RS:1;jenkins-hbase4:38533] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:03:21,758 INFO [RS:0;jenkins-hbase4:32827] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32827,1675839801444-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,758 INFO [RS:1;jenkins-hbase4:38533] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38533,1675839801469-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:21,769 INFO [RS:1;jenkins-hbase4:38533] regionserver.Replication(203): jenkins-hbase4.apache.org,38533,1675839801469 started 2023-02-08 07:03:21,769 INFO [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38533,1675839801469, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38533, sessionid=0x10032bdf1e10002 2023-02-08 07:03:21,769 INFO [RS:0;jenkins-hbase4:32827] regionserver.Replication(203): jenkins-hbase4.apache.org,32827,1675839801444 started 2023-02-08 07:03:21,769 DEBUG [RS:1;jenkins-hbase4:38533] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:03:21,769 INFO [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,32827,1675839801444, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32827, sessionid=0x10032bdf1e10001 2023-02-08 07:03:21,769 DEBUG [RS:1;jenkins-hbase4:38533] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:21,769 DEBUG [RS:0;jenkins-hbase4:32827] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:03:21,769 DEBUG [RS:0;jenkins-hbase4:32827] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:21,769 DEBUG [RS:0;jenkins-hbase4:32827] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32827,1675839801444' 2023-02-08 07:03:21,769 DEBUG [RS:0;jenkins-hbase4:32827] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:21,769 DEBUG [RS:1;jenkins-hbase4:38533] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38533,1675839801469' 2023-02-08 07:03:21,769 DEBUG [RS:1;jenkins-hbase4:38533] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:21,770 DEBUG [RS:0;jenkins-hbase4:32827] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:21,770 DEBUG [RS:1;jenkins-hbase4:38533] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:21,770 DEBUG [RS:0;jenkins-hbase4:32827] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:03:21,770 DEBUG [RS:0;jenkins-hbase4:32827] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:03:21,770 DEBUG [RS:0;jenkins-hbase4:32827] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:21,770 DEBUG [RS:1;jenkins-hbase4:38533] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:03:21,770 DEBUG [RS:1;jenkins-hbase4:38533] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:03:21,770 DEBUG [RS:1;jenkins-hbase4:38533] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:21,770 DEBUG [RS:1;jenkins-hbase4:38533] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38533,1675839801469' 2023-02-08 07:03:21,770 DEBUG [RS:1;jenkins-hbase4:38533] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:21,770 DEBUG [RS:0;jenkins-hbase4:32827] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32827,1675839801444' 2023-02-08 07:03:21,770 DEBUG [RS:0;jenkins-hbase4:32827] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:21,770 DEBUG [RS:1;jenkins-hbase4:38533] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:21,770 DEBUG [RS:0;jenkins-hbase4:32827] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:21,771 DEBUG [RS:1;jenkins-hbase4:38533] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:03:21,771 DEBUG [RS:0;jenkins-hbase4:32827] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:03:21,771 INFO [RS:1;jenkins-hbase4:38533] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:03:21,771 INFO [RS:1;jenkins-hbase4:38533] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:03:21,771 INFO [RS:0;jenkins-hbase4:32827] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:03:21,771 INFO [RS:0;jenkins-hbase4:32827] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:03:22,038 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:22,039 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:03:22,040 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/info 2023-02-08 07:03:22,041 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:03:22,041 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:22,041 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:03:22,042 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:22,043 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:03:22,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:22,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:03:22,044 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/table 2023-02-08 07:03:22,044 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:03:22,045 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:22,045 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740 2023-02-08 07:03:22,046 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740 2023-02-08 07:03:22,047 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:03:22,048 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:03:22,050 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:22,051 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64138672, jitterRate=-0.04425930976867676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:03:22,051 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675839802038Initializing all the Stores at 1675839802039 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839802039Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839802039Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839802039Cleaning up temporary data from old regions at 1675839802047 (+8 ms)Cleaning up detritus from prior splits at 1675839802047Region opened successfully at 1675839802051 (+4 ms) 2023-02-08 07:03:22,051 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:03:22,051 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:03:22,051 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:03:22,051 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:03:22,051 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:03:22,051 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:22,051 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839802051Disabling compacts and flushes for region at 1675839802051Disabling writes for close at 1675839802051Writing region close event to WAL at 1675839802051Closed at 1675839802051 2023-02-08 07:03:22,052 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:22,052 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 07:03:22,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 07:03:22,054 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 07:03:22,055 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 07:03:22,206 DEBUG [jenkins-hbase4:37609] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 07:03:22,206 DEBUG [jenkins-hbase4:37609] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:22,207 DEBUG [jenkins-hbase4:37609] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:22,207 DEBUG [jenkins-hbase4:37609] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:22,207 DEBUG [jenkins-hbase4:37609] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:22,208 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32827,1675839801444, state=OPENING 2023-02-08 07:03:22,209 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 07:03:22,210 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:22,210 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:03:22,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32827,1675839801444}] 2023-02-08 07:03:22,366 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:22,367 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:03:22,368 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46068, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:03:22,372 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 07:03:22,373 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:22,374 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32827%2C1675839801444.meta, suffix=.meta, logDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/WALs/jenkins-hbase4.apache.org,32827,1675839801444, archiveDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/oldWALs, maxLogs=32 2023-02-08 07:03:22,394 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34357,DS-ade423d1-ceea-4699-8c23-2d8c67b60585,DISK] 2023-02-08 07:03:22,395 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40973,DS-1e104cb0-572b-447f-abe1-1df65aee9208,DISK] 2023-02-08 07:03:22,396 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/WALs/jenkins-hbase4.apache.org,32827,1675839801444/jenkins-hbase4.apache.org%2C32827%2C1675839801444.meta.1675839802374.meta 2023-02-08 07:03:22,396 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34357,DS-ade423d1-ceea-4699-8c23-2d8c67b60585,DISK], DatanodeInfoWithStorage[127.0.0.1:40973,DS-1e104cb0-572b-447f-abe1-1df65aee9208,DISK]] 2023-02-08 07:03:22,396 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:22,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 07:03:22,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 07:03:22,397 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 07:03:22,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 07:03:22,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:22,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 07:03:22,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 07:03:22,398 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:03:22,399 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/info 2023-02-08 07:03:22,399 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/info 2023-02-08 07:03:22,399 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:03:22,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:22,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:03:22,401 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:22,401 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:22,401 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:03:22,401 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:22,402 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:03:22,402 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/table 2023-02-08 07:03:22,402 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/table 2023-02-08 07:03:22,402 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:03:22,403 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:22,403 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740 2023-02-08 07:03:22,404 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740 2023-02-08 07:03:22,405 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:03:22,406 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:03:22,407 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61182304, jitterRate=-0.08831262588500977}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:03:22,407 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675839802397Writing region info on filesystem at 1675839802397Initializing all the Stores at 1675839802398 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839802398Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839802398Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839802398Cleaning up temporary data from old regions at 1675839802405 (+7 ms)Cleaning up detritus from prior splits at 1675839802405Running coprocessor post-open hooks at 1675839802407 (+2 ms)Region opened successfully at 1675839802407 2023-02-08 07:03:22,407 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675839802366 2023-02-08 07:03:22,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 07:03:22,411 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 07:03:22,411 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32827,1675839801444, state=OPEN 2023-02-08 07:03:22,412 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 07:03:22,412 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:03:22,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 07:03:22,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32827,1675839801444 in 202 msec 2023-02-08 07:03:22,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 07:03:22,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-02-08 07:03:22,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 806 msec 2023-02-08 07:03:22,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675839801490, completionTime=-1 2023-02-08 07:03:22,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 07:03:22,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 07:03:22,419 DEBUG [hconnection-0x39343999-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:22,423 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46072, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:22,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 07:03:22,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675839862425 2023-02-08 07:03:22,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675839922425 2023-02-08 07:03:22,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-08 07:03:22,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37609,1675839801394-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:22,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37609,1675839801394-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:22,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37609,1675839801394-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:22,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37609, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:22,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:22,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 07:03:22,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:22,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 07:03:22,433 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 07:03:22,434 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:03:22,434 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:03:22,436 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b 2023-02-08 07:03:22,436 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b empty. 2023-02-08 07:03:22,436 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b 2023-02-08 07:03:22,436 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 07:03:22,444 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:22,445 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3518824ac5e95a753a969dcc0e89396b, NAME => 'hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp 2023-02-08 07:03:22,452 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:22,452 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 3518824ac5e95a753a969dcc0e89396b, disabling compactions & flushes 2023-02-08 07:03:22,452 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. 2023-02-08 07:03:22,452 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. 2023-02-08 07:03:22,452 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. after waiting 0 ms 2023-02-08 07:03:22,452 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. 2023-02-08 07:03:22,452 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. 2023-02-08 07:03:22,452 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 3518824ac5e95a753a969dcc0e89396b: Waiting for close lock at 1675839802452Disabling compacts and flushes for region at 1675839802452Disabling writes for close at 1675839802452Writing region close event to WAL at 1675839802452Closed at 1675839802452 2023-02-08 07:03:22,454 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:03:22,455 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839802454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839802454"}]},"ts":"1675839802454"} 2023-02-08 07:03:22,457 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 07:03:22,457 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:03:22,458 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839802458"}]},"ts":"1675839802458"} 2023-02-08 07:03:22,459 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 07:03:22,463 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:22,463 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:22,463 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:22,463 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:22,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3518824ac5e95a753a969dcc0e89396b, ASSIGN}] 2023-02-08 07:03:22,465 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3518824ac5e95a753a969dcc0e89396b, ASSIGN 2023-02-08 07:03:22,466 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3518824ac5e95a753a969dcc0e89396b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38533,1675839801469; forceNewPlan=false, retain=false 2023-02-08 07:03:22,616 INFO [jenkins-hbase4:37609] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 07:03:22,616 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3518824ac5e95a753a969dcc0e89396b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:22,616 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839802616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839802616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839802616"}]},"ts":"1675839802616"} 2023-02-08 07:03:22,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3518824ac5e95a753a969dcc0e89396b, server=jenkins-hbase4.apache.org,38533,1675839801469}] 2023-02-08 07:03:22,770 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:22,771 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:03:22,772 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51222, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:03:22,772 INFO [RS:1;jenkins-hbase4:38533] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38533%2C1675839801469, suffix=, logDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/WALs/jenkins-hbase4.apache.org,38533,1675839801469, archiveDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/oldWALs, maxLogs=32 2023-02-08 07:03:22,774 INFO [RS:0;jenkins-hbase4:32827] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32827%2C1675839801444, suffix=, logDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/WALs/jenkins-hbase4.apache.org,32827,1675839801444, archiveDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/oldWALs, maxLogs=32 2023-02-08 07:03:22,775 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. 2023-02-08 07:03:22,786 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40973,DS-1e104cb0-572b-447f-abe1-1df65aee9208,DISK] 2023-02-08 07:03:22,786 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34357,DS-ade423d1-ceea-4699-8c23-2d8c67b60585,DISK] 2023-02-08 07:03:22,787 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34357,DS-ade423d1-ceea-4699-8c23-2d8c67b60585,DISK] 2023-02-08 07:03:22,787 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40973,DS-1e104cb0-572b-447f-abe1-1df65aee9208,DISK] 2023-02-08 07:03:22,788 INFO [RS:0;jenkins-hbase4:32827] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/WALs/jenkins-hbase4.apache.org,32827,1675839801444/jenkins-hbase4.apache.org%2C32827%2C1675839801444.1675839802774 2023-02-08 07:03:22,792 DEBUG [RS:0;jenkins-hbase4:32827] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40973,DS-1e104cb0-572b-447f-abe1-1df65aee9208,DISK], DatanodeInfoWithStorage[127.0.0.1:34357,DS-ade423d1-ceea-4699-8c23-2d8c67b60585,DISK]] 2023-02-08 07:03:22,792 INFO [RS:1;jenkins-hbase4:38533] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/WALs/jenkins-hbase4.apache.org,38533,1675839801469/jenkins-hbase4.apache.org%2C38533%2C1675839801469.1675839802774 2023-02-08 07:03:22,792 DEBUG [RS:1;jenkins-hbase4:38533] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34357,DS-ade423d1-ceea-4699-8c23-2d8c67b60585,DISK], DatanodeInfoWithStorage[127.0.0.1:40973,DS-1e104cb0-572b-447f-abe1-1df65aee9208,DISK]] 2023-02-08 07:03:22,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3518824ac5e95a753a969dcc0e89396b, NAME => 'hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:22,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3518824ac5e95a753a969dcc0e89396b 2023-02-08 07:03:22,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:22,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3518824ac5e95a753a969dcc0e89396b 2023-02-08 07:03:22,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3518824ac5e95a753a969dcc0e89396b 2023-02-08 07:03:22,793 INFO [StoreOpener-3518824ac5e95a753a969dcc0e89396b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3518824ac5e95a753a969dcc0e89396b 2023-02-08 07:03:22,795 DEBUG [StoreOpener-3518824ac5e95a753a969dcc0e89396b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b/info 2023-02-08 07:03:22,795 DEBUG [StoreOpener-3518824ac5e95a753a969dcc0e89396b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b/info 2023-02-08 07:03:22,795 INFO [StoreOpener-3518824ac5e95a753a969dcc0e89396b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3518824ac5e95a753a969dcc0e89396b columnFamilyName info 2023-02-08 07:03:22,795 INFO [StoreOpener-3518824ac5e95a753a969dcc0e89396b-1] regionserver.HStore(310): Store=3518824ac5e95a753a969dcc0e89396b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:22,796 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b 2023-02-08 07:03:22,796 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b 2023-02-08 07:03:22,798 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3518824ac5e95a753a969dcc0e89396b 2023-02-08 07:03:22,800 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:22,800 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3518824ac5e95a753a969dcc0e89396b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65784770, jitterRate=-0.01973053812980652}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:03:22,800 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3518824ac5e95a753a969dcc0e89396b: Running coprocessor pre-open hook at 1675839802792Writing region info on filesystem at 1675839802792Initializing all the Stores at 1675839802793 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839802793Cleaning up temporary data from old regions at 1675839802797 (+4 ms)Cleaning up detritus from prior splits at 1675839802797Running coprocessor post-open hooks at 1675839802800 (+3 ms)Region opened successfully at 1675839802800 2023-02-08 07:03:22,801 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b., pid=6, masterSystemTime=1675839802770 2023-02-08 07:03:22,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. 2023-02-08 07:03:22,804 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. 2023-02-08 07:03:22,805 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3518824ac5e95a753a969dcc0e89396b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:22,805 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839802804"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839802804"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839802804"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839802804"}]},"ts":"1675839802804"} 2023-02-08 07:03:22,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 07:03:22,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3518824ac5e95a753a969dcc0e89396b, server=jenkins-hbase4.apache.org,38533,1675839801469 in 188 msec 2023-02-08 07:03:22,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 07:03:22,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3518824ac5e95a753a969dcc0e89396b, ASSIGN in 344 msec 2023-02-08 07:03:22,808 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:03:22,809 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839802809"}]},"ts":"1675839802809"} 2023-02-08 07:03:22,810 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 07:03:22,811 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:03:22,812 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 379 msec 2023-02-08 07:03:22,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 07:03:22,835 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:22,835 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:22,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:22,839 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51234, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:22,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 07:03:22,854 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:22,857 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 16 msec 2023-02-08 07:03:22,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 07:03:22,869 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:22,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-08 07:03:22,878 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 07:03:22,880 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 07:03:22,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.384sec 2023-02-08 07:03:22,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 07:03:22,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 07:03:22,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 07:03:22,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37609,1675839801394-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 07:03:22,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37609,1675839801394-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 07:03:22,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 07:03:22,890 DEBUG [Listener at localhost/41689] zookeeper.ReadOnlyZKClient(139): Connect 0x40c50cb3 to 127.0.0.1:51950 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:22,902 DEBUG [Listener at localhost/41689] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30a5f8ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:22,903 DEBUG [hconnection-0x3562ab1f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:22,905 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46076, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:22,907 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37609,1675839801394 2023-02-08 07:03:22,907 DEBUG [Listener at localhost/41689] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 07:03:22,907 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:22,907 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:22,911 DEBUG [Listener at localhost/41689] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 07:03:22,913 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47448, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 07:03:22,914 INFO [Listener at localhost/41689] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-08 07:03:22,914 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-08 07:03:22,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 07:03:22,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:47448 deadline: 1675839862914, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-08 07:03:22,915 INFO [Listener at localhost/41689] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-08 07:03:22,916 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:22,916 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:22,918 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:22,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:22,920 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:03:22,921 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-08 07:03:22,921 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:22,921 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:22,921 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:03:22,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:22,922 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:22,924 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b empty. 2023-02-08 07:03:22,924 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:22,924 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-08 07:03:22,943 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:22,944 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 26ebae38cbb4842d4e8475ee2397819b, NAME => 'testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp 2023-02-08 07:03:22,954 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:22,954 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 26ebae38cbb4842d4e8475ee2397819b, disabling compactions & flushes 2023-02-08 07:03:22,954 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:22,954 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:22,954 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. after waiting 0 ms 2023-02-08 07:03:22,954 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:22,954 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:22,954 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 26ebae38cbb4842d4e8475ee2397819b: Waiting for close lock at 1675839802954Disabling compacts and flushes for region at 1675839802954Disabling writes for close at 1675839802954Writing region close event to WAL at 1675839802954Closed at 1675839802954 2023-02-08 07:03:22,956 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:03:22,957 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675839802957"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839802957"}]},"ts":"1675839802957"} 2023-02-08 07:03:22,958 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 07:03:22,959 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:03:22,959 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839802959"}]},"ts":"1675839802959"} 2023-02-08 07:03:22,960 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-08 07:03:22,963 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:22,964 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:22,964 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:22,964 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:22,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=26ebae38cbb4842d4e8475ee2397819b, ASSIGN}] 2023-02-08 07:03:22,966 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=26ebae38cbb4842d4e8475ee2397819b, ASSIGN 2023-02-08 07:03:22,966 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=26ebae38cbb4842d4e8475ee2397819b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32827,1675839801444; forceNewPlan=false, retain=false 2023-02-08 07:03:23,022 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:23,022 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:23,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:23,117 INFO [jenkins-hbase4:37609] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 07:03:23,117 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=26ebae38cbb4842d4e8475ee2397819b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,117 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675839803117"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839803117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839803117"}]},"ts":"1675839803117"} 2023-02-08 07:03:23,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 26ebae38cbb4842d4e8475ee2397819b, server=jenkins-hbase4.apache.org,32827,1675839801444}] 2023-02-08 07:03:23,224 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:23,224 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:23,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:23,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:23,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 26ebae38cbb4842d4e8475ee2397819b, NAME => 'testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:23,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:23,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:23,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:23,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:23,275 INFO [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:23,276 DEBUG [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1 2023-02-08 07:03:23,276 DEBUG [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1 2023-02-08 07:03:23,276 INFO [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26ebae38cbb4842d4e8475ee2397819b columnFamilyName f1 2023-02-08 07:03:23,276 INFO [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] regionserver.HStore(310): Store=26ebae38cbb4842d4e8475ee2397819b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:23,277 INFO [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:23,277 DEBUG [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2 2023-02-08 07:03:23,277 DEBUG [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2 2023-02-08 07:03:23,278 INFO [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26ebae38cbb4842d4e8475ee2397819b columnFamilyName f2 2023-02-08 07:03:23,278 INFO [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] regionserver.HStore(310): Store=26ebae38cbb4842d4e8475ee2397819b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:23,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:23,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:23,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:23,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:23,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:23,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 26ebae38cbb4842d4e8475ee2397819b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71439231, jitterRate=0.0645274966955185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:23,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 26ebae38cbb4842d4e8475ee2397819b: Running coprocessor pre-open hook at 1675839803274Writing region info on filesystem at 1675839803274Initializing all the Stores at 1675839803274Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839803274Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839803275 (+1 ms)Cleaning up temporary data from old regions at 1675839803280 (+5 ms)Cleaning up detritus from prior splits at 1675839803280Running coprocessor post-open hooks at 1675839803283 (+3 ms)Region opened successfully at 1675839803283 2023-02-08 07:03:23,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b., pid=12, masterSystemTime=1675839803270 2023-02-08 07:03:23,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:23,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:23,286 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=26ebae38cbb4842d4e8475ee2397819b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,286 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675839803285"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839803285"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839803285"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839803285"}]},"ts":"1675839803285"} 2023-02-08 07:03:23,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-08 07:03:23,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 26ebae38cbb4842d4e8475ee2397819b, server=jenkins-hbase4.apache.org,32827,1675839801444 in 168 msec 2023-02-08 07:03:23,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-08 07:03:23,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=26ebae38cbb4842d4e8475ee2397819b, ASSIGN in 324 msec 2023-02-08 07:03:23,290 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:03:23,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839803290"}]},"ts":"1675839803290"} 2023-02-08 07:03:23,291 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-08 07:03:23,293 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:03:23,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 375 msec 2023-02-08 07:03:23,526 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:23,526 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:23,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:23,527 INFO [Listener at localhost/41689] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-08 07:03:23,527 DEBUG [Listener at localhost/41689] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-08 07:03:23,527 INFO [Listener at localhost/41689] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:03:23,531 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-08 07:03:23,531 INFO [Listener at localhost/41689] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:03:23,531 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-08 07:03:23,531 INFO [Listener at localhost/41689] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 07:03:23,561 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32827] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:23,730 INFO [Listener at localhost/41689] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 07:03:23,730 INFO [Listener at localhost/41689] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 07:03:23,730 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:23,730 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:23,731 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-08 07:03:23,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675839803731 (current time:1675839803731). 2023-02-08 07:03:23,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 07:03:23,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] zookeeper.ReadOnlyZKClient(139): Connect 0x5da2561a to 127.0.0.1:51950 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:23,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@462bf58b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:23,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:23,737 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33048, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:23,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5da2561a to 127.0.0.1:51950 2023-02-08 07:03:23,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:23,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 07:03:23,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-08 07:03:23,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-08 07:03:23,742 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-08 07:03:23,742 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675840403742 2023-02-08 07:03:23,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-08 07:03:23,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,748 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-08 07:03:23,748 DEBUG [Listener at localhost/41689] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 07:03:23,748 DEBUG [Listener at localhost/41689] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 07:03:23,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-08 07:03:23,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 8 msec 2023-02-08 07:03:23,750 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-08 07:03:23,750 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1675840403750 2023-02-08 07:03:23,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,760 INFO [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-08 07:03:23,760 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:23,761 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-08 07:03:23,761 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-08 07:03:23,761 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,761 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,762 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:23,762 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:23,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:23,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:23,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:23,762 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:23,763 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,763 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:03:23,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-08 07:03:23,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-08 07:03:23,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,764 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-08 07:03:23,764 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-08 07:03:23,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,764 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-08 07:03:23,764 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:23,765 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-08 07:03:23,765 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-08 07:03:23,765 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-08 07:03:23,765 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:23,765 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38533,1675839801469' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-08 07:03:23,766 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-08 07:03:23,766 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-08 07:03:23,766 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32827,1675839801444' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-08 07:03:23,767 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,768 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,768 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:23,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:23,769 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,769 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:23,769 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,769 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:23,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:23,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:23,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:23,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:23,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32827,1675839801444' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-08 07:03:23,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32f3cd8f[Count = 0] remaining members to acquire global barrier 2023-02-08 07:03:23,770 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-08 07:03:23,770 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,771 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,771 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,772 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-08 07:03:23,772 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-08 07:03:23,772 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-08 07:03:23,772 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38533,1675839801469' in zk 2023-02-08 07:03:23,772 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,772 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:03:23,772 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-08 07:03:23,772 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 07:03:23,772 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:23,772 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. started... 2023-02-08 07:03:23,772 INFO [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 26ebae38cbb4842d4e8475ee2397819b 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-08 07:03:23,773 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-08 07:03:23,773 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:23,773 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-08 07:03:23,791 INFO [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/.tmp/f1/97aa7380e5fd41e18d655747bb706858 2023-02-08 07:03:23,807 INFO [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/.tmp/f2/068d4b1bf57b4a98b29b4794ee78dea3 2023-02-08 07:03:23,811 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/.tmp/f1/97aa7380e5fd41e18d655747bb706858 as hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1/97aa7380e5fd41e18d655747bb706858 2023-02-08 07:03:23,814 INFO [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1/97aa7380e5fd41e18d655747bb706858, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 07:03:23,815 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/.tmp/f2/068d4b1bf57b4a98b29b4794ee78dea3 as hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2/068d4b1bf57b4a98b29b4794ee78dea3 2023-02-08 07:03:23,818 INFO [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2/068d4b1bf57b4a98b29b4794ee78dea3, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 07:03:23,819 INFO [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 26ebae38cbb4842d4e8475ee2397819b in 47ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:23,819 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-08 07:03:23,820 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 26ebae38cbb4842d4e8475ee2397819b: 2023-02-08 07:03:23,820 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,820 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:23,820 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1/97aa7380e5fd41e18d655747bb706858] hfiles 2023-02-08 07:03:23,820 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1/97aa7380e5fd41e18d655747bb706858 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,820 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2/068d4b1bf57b4a98b29b4794ee78dea3] hfiles 2023-02-08 07:03:23,820 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2/068d4b1bf57b4a98b29b4794ee78dea3 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,825 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. completed. 2023-02-08 07:03:23,826 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:23,826 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-08 07:03:23,826 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-08 07:03:23,826 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,826 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-08 07:03:23,826 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,32827,1675839801444' in zk 2023-02-08 07:03:23,827 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-08 07:03:23,827 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,827 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:23,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:23,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:23,827 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-08 07:03:23,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:23,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:23,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:23,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:23,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:23,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,32827,1675839801444': 2023-02-08 07:03:23,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32827,1675839801444' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-08 07:03:23,830 INFO [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-08 07:03:23,830 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:03:23,830 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:03:23,830 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,830 INFO [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 07:03:23,833 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,833 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,833 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,833 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:23,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:23,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:23,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,833 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:23,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:23,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:23,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:23,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:23,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:23,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:23,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:23,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,837 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:23,837 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,838 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:23,838 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,843 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,843 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:23,843 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:23,843 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:23,843 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:23,843 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:23,843 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:23,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:23,843 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:23,844 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,844 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:23,844 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:23,844 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,844 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:23,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:23,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:23,844 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:23,844 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,848 DEBUG [Listener at localhost/41689] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:23,848 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:23,849 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:23,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-08 07:03:23,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:03:23,850 DEBUG [Listener at localhost/41689] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 07:03:23,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,871 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-08 07:03:23,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,871 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:23,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1675839803747Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1675839803844 (+97 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1675839803844Writing data manifest for testWithMockedMapReduceSingleRegion at 1675839803846 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1675839803852 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1675839803871 (+19 ms) 2023-02-08 07:03:23,874 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-08 07:03:23,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 127 msec 2023-02-08 07:03:24,050 DEBUG [Listener at localhost/41689] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:24,050 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:24,050 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:24,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-08 07:03:24,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 07:03:24,052 INFO [Listener at localhost/41689] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 07:03:24,052 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:24,052 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:24,055 INFO [Listener at localhost/41689] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 07:03:24,060 INFO [Listener at localhost/41689] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 07:03:24,086 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32827] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,164 INFO [Listener at localhost/41689] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 07:03:24,167 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:24,168 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:24,169 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 07:03:24,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,171 INFO [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-08 07:03:24,171 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:24,172 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-08 07:03:24,173 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-08 07:03:24,173 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,173 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,174 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,174 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:24,174 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:24,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:24,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:24,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:24,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:24,175 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,175 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:03:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:03:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:03:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,176 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,176 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,176 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,176 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,176 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-08 07:03:24,176 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:24,176 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-08 07:03:24,176 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:24,177 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-08 07:03:24,178 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-08 07:03:24,178 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-08 07:03:24,178 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38533,1675839801469' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-08 07:03:24,178 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 07:03:24,178 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 07:03:24,178 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,178 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. started... 2023-02-08 07:03:24,178 INFO [rs(jenkins-hbase4.apache.org,32827,1675839801444)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 26ebae38cbb4842d4e8475ee2397819b 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-08 07:03:24,180 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,181 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,181 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:24,194 INFO [rs(jenkins-hbase4.apache.org,32827,1675839801444)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/.tmp/f1/d620542faefe4e5691d7146f762b38ad 2023-02-08 07:03:24,213 INFO [rs(jenkins-hbase4.apache.org,32827,1675839801444)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/.tmp/f2/2f49ca9dc9d94866ad2048df554f19a0 2023-02-08 07:03:24,218 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/.tmp/f1/d620542faefe4e5691d7146f762b38ad as hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1/d620542faefe4e5691d7146f762b38ad 2023-02-08 07:03:24,223 INFO [rs(jenkins-hbase4.apache.org,32827,1675839801444)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1/d620542faefe4e5691d7146f762b38ad, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 07:03:24,224 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/.tmp/f2/2f49ca9dc9d94866ad2048df554f19a0 as hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2/2f49ca9dc9d94866ad2048df554f19a0 2023-02-08 07:03:24,229 INFO [rs(jenkins-hbase4.apache.org,32827,1675839801444)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2/2f49ca9dc9d94866ad2048df554f19a0, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 07:03:24,229 INFO [rs(jenkins-hbase4.apache.org,32827,1675839801444)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 26ebae38cbb4842d4e8475ee2397819b in 51ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:24,230 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 26ebae38cbb4842d4e8475ee2397819b: 2023-02-08 07:03:24,230 DEBUG [rs(jenkins-hbase4.apache.org,32827,1675839801444)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,230 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 07:03:24,230 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 07:03:24,230 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-08 07:03:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32827,1675839801444' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-08 07:03:24,232 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,232 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:24,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:24,232 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,232 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:24,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:24,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:24,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:24,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:24,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32827,1675839801444' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-08 07:03:24,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36cc4f09[Count = 0] remaining members to acquire global barrier 2023-02-08 07:03:24,234 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-08 07:03:24,234 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,235 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,235 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,235 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-08 07:03:24,235 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-08 07:03:24,235 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,235 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:03:24,235 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-08 07:03:24,235 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,32827,1675839801444' in zk 2023-02-08 07:03:24,235 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-08 07:03:24,236 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38533,1675839801469' in zk 2023-02-08 07:03:24,237 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:24,237 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-08 07:03:24,237 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:24,237 DEBUG [member: 'jenkins-hbase4.apache.org,32827,1675839801444' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-08 07:03:24,239 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-08 07:03:24,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:24,239 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:24,239 DEBUG [member: 'jenkins-hbase4.apache.org,38533,1675839801469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-08 07:03:24,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:24,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:24,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,32827,1675839801444': 2023-02-08 07:03:24,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32827,1675839801444' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-08 07:03:24,241 INFO [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-08 07:03:24,241 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:03:24,241 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:03:24,241 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,241 INFO [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 07:03:24,243 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,243 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:24,243 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:24,243 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,243 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:24,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:24,243 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:24,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:24,244 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:24,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:24,245 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:24,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,246 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:24,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:24,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,248 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:24,248 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:24,248 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:24,248 DEBUG [(jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:24,248 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-08 07:03:24,248 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 07:03:24,248 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:24,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:24,248 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,248 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:24,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:24,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:24,248 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:24,248 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,248 DEBUG [Listener at localhost/41689] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-08 07:03:24,248 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,249 DEBUG [Listener at localhost/41689] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 07:03:24,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:24,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:24,249 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:24,249 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:24,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:24,249 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,249 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,349 DEBUG [Listener at localhost/41689] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 07:03:24,349 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:24,349 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:24,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 07:03:24,354 INFO [Listener at localhost/41689] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675839803731 type: FLUSH version: 2 ttl: 0 2023-02-08 07:03:24,354 DEBUG [Listener at localhost/41689] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45671/user/jenkins/test-data/4c27c03a-80b5-d9e2-33eb-de300e5cf595/testWithMockedMapReduceSingleRegion/871cd95d-f4ba-4c52-b5e7-4590d5292f24/data/default/testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,355 INFO [Listener at localhost/41689] snapshot.RestoreSnapshotHelper(239): region to add: 26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:24,355 INFO [Listener at localhost/41689] snapshot.RestoreSnapshotHelper(585): clone region=26ebae38cbb4842d4e8475ee2397819b as 26ebae38cbb4842d4e8475ee2397819b in snapshot testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,356 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 26ebae38cbb4842d4e8475ee2397819b, NAME => 'testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45671/user/jenkins/test-data/4c27c03a-80b5-d9e2-33eb-de300e5cf595/testWithMockedMapReduceSingleRegion/871cd95d-f4ba-4c52-b5e7-4590d5292f24 2023-02-08 07:03:24,362 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:24,362 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 97aa7380e5fd41e18d655747bb706858 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,363 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 068d4b1bf57b4a98b29b4794ee78dea3 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,365 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 26ebae38cbb4842d4e8475ee2397819b, disabling compactions & flushes 2023-02-08 07:03:24,365 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,365 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,365 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. after waiting 0 ms 2023-02-08 07:03:24,365 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,365 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,365 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 26ebae38cbb4842d4e8475ee2397819b: Waiting for close lock at 1675839804365Disabling compacts and flushes for region at 1675839804365Disabling writes for close at 1675839804365Writing region close event to WAL at 1675839804365Closed at 1675839804365 2023-02-08 07:03:24,365 INFO [Listener at localhost/41689] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675839803731 type: FLUSH version: 2 ttl: 0 2023-02-08 07:03:24,366 DEBUG [Listener at localhost/41689] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45671/user/jenkins/test-data/4c27c03a-80b5-d9e2-33eb-de300e5cf595/testWithMockedMapReduceSingleRegion/871cd95d-f4ba-4c52-b5e7-4590d5292f24 2023-02-08 07:03:24,366 DEBUG [Listener at localhost/41689] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45671/user/jenkins/test-data/4c27c03a-80b5-d9e2-33eb-de300e5cf595/testWithMockedMapReduceSingleRegion/871cd95d-f4ba-4c52-b5e7-4590d5292f24 2023-02-08 07:03:24,366 DEBUG [Listener at localhost/41689] util.CommonFSUtils(699): |-data/ 2023-02-08 07:03:24,366 DEBUG [Listener at localhost/41689] util.CommonFSUtils(699): |----default/ 2023-02-08 07:03:24,366 DEBUG [Listener at localhost/41689] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-08 07:03:24,367 DEBUG [Listener at localhost/41689] util.CommonFSUtils(699): |----------26ebae38cbb4842d4e8475ee2397819b/ 2023-02-08 07:03:24,367 DEBUG [Listener at localhost/41689] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:24,367 DEBUG [Listener at localhost/41689] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:24,367 DEBUG [Listener at localhost/41689] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=26ebae38cbb4842d4e8475ee2397819b-97aa7380e5fd41e18d655747bb706858 2023-02-08 07:03:24,368 DEBUG [Listener at localhost/41689] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:24,368 DEBUG [Listener at localhost/41689] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=26ebae38cbb4842d4e8475ee2397819b-068d4b1bf57b4a98b29b4794ee78dea3 2023-02-08 07:03:24,370 INFO [Listener at localhost/41689] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-08 07:03:24,373 DEBUG [Listener at localhost/41689] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:24,373 INFO [Listener at localhost/41689] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:24,374 DEBUG [Listener at localhost/41689] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:24,376 INFO [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:24,376 DEBUG [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/4c27c03a-80b5-d9e2-33eb-de300e5cf595/testWithMockedMapReduceSingleRegion/871cd95d-f4ba-4c52-b5e7-4590d5292f24/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1 2023-02-08 07:03:24,376 INFO [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26ebae38cbb4842d4e8475ee2397819b columnFamilyName f1 2023-02-08 07:03:24,380 DEBUG [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] regionserver.HStore(539): loaded hdfs://localhost:45671/user/jenkins/test-data/4c27c03a-80b5-d9e2-33eb-de300e5cf595/testWithMockedMapReduceSingleRegion/871cd95d-f4ba-4c52-b5e7-4590d5292f24/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1/testWithMockedMapReduceSingleRegion=26ebae38cbb4842d4e8475ee2397819b-97aa7380e5fd41e18d655747bb706858 2023-02-08 07:03:24,380 INFO [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] regionserver.HStore(310): Store=26ebae38cbb4842d4e8475ee2397819b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:24,380 INFO [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:24,380 DEBUG [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45671/user/jenkins/test-data/4c27c03a-80b5-d9e2-33eb-de300e5cf595/testWithMockedMapReduceSingleRegion/871cd95d-f4ba-4c52-b5e7-4590d5292f24/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2 2023-02-08 07:03:24,381 INFO [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26ebae38cbb4842d4e8475ee2397819b columnFamilyName f2 2023-02-08 07:03:24,384 DEBUG [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] regionserver.HStore(539): loaded hdfs://localhost:45671/user/jenkins/test-data/4c27c03a-80b5-d9e2-33eb-de300e5cf595/testWithMockedMapReduceSingleRegion/871cd95d-f4ba-4c52-b5e7-4590d5292f24/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2/testWithMockedMapReduceSingleRegion=26ebae38cbb4842d4e8475ee2397819b-068d4b1bf57b4a98b29b4794ee78dea3 2023-02-08 07:03:24,384 INFO [StoreOpener-26ebae38cbb4842d4e8475ee2397819b-1] regionserver.HStore(310): Store=26ebae38cbb4842d4e8475ee2397819b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:24,384 DEBUG [Listener at localhost/41689] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:24,385 INFO [Listener at localhost/41689] regionserver.HRegion(1071): Opened 26ebae38cbb4842d4e8475ee2397819b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64151991, jitterRate=-0.0440608412027359}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:24,385 DEBUG [Listener at localhost/41689] regionserver.HRegion(964): Region open journal for 26ebae38cbb4842d4e8475ee2397819b: Writing region info on filesystem at 1675839804374Initializing all the Stores at 1675839804374Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839804374Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839804374Region opened successfully at 1675839804385 (+11 ms) 2023-02-08 07:03:24,429 DEBUG [Listener at localhost/41689] regionserver.HRegion(1603): Closing 26ebae38cbb4842d4e8475ee2397819b, disabling compactions & flushes 2023-02-08 07:03:24,429 INFO [Listener at localhost/41689] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,429 DEBUG [Listener at localhost/41689] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,429 DEBUG [Listener at localhost/41689] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. after waiting 0 ms 2023-02-08 07:03:24,429 DEBUG [Listener at localhost/41689] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,430 INFO [Listener at localhost/41689] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,430 DEBUG [Listener at localhost/41689] regionserver.HRegion(1557): Region close journal for 26ebae38cbb4842d4e8475ee2397819b: Waiting for close lock at 1675839804429Disabling compacts and flushes for region at 1675839804429Disabling writes for close at 1675839804429Writing region close event to WAL at 1675839804430 (+1 ms)Closed at 1675839804430 2023-02-08 07:03:24,433 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:24,433 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:24,435 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-08 07:03:24,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,437 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:24,437 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:24,438 INFO [Listener at localhost/41689] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,438 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,441 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:24,441 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:24,441 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839804441"}]},"ts":"1675839804441"} 2023-02-08 07:03:24,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 07:03:24,442 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-08 07:03:24,444 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-08 07:03:24,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=26ebae38cbb4842d4e8475ee2397819b, UNASSIGN}] 2023-02-08 07:03:24,446 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=26ebae38cbb4842d4e8475ee2397819b, UNASSIGN 2023-02-08 07:03:24,447 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=26ebae38cbb4842d4e8475ee2397819b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,447 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675839804447"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839804447"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839804447"}]},"ts":"1675839804447"} 2023-02-08 07:03:24,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 26ebae38cbb4842d4e8475ee2397819b, server=jenkins-hbase4.apache.org,32827,1675839801444}] 2023-02-08 07:03:24,542 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:24,542 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:24,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 07:03:24,545 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 07:03:24,545 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-08 07:03:24,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:24,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 26ebae38cbb4842d4e8475ee2397819b, disabling compactions & flushes 2023-02-08 07:03:24,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. after waiting 0 ms 2023-02-08 07:03:24,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:24,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b. 2023-02-08 07:03:24,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 26ebae38cbb4842d4e8475ee2397819b: Waiting for close lock at 1675839804600Running coprocessor pre-close hooks at 1675839804600Disabling compacts and flushes for region at 1675839804600Disabling writes for close at 1675839804600Writing region close event to WAL at 1675839804601 (+1 ms)Running coprocessor post-close hooks at 1675839804604 (+3 ms)Closed at 1675839804604 2023-02-08 07:03:24,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:24,606 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=26ebae38cbb4842d4e8475ee2397819b, regionState=CLOSED 2023-02-08 07:03:24,606 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675839804606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839804606"}]},"ts":"1675839804606"} 2023-02-08 07:03:24,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-08 07:03:24,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 26ebae38cbb4842d4e8475ee2397819b, server=jenkins-hbase4.apache.org,32827,1675839801444 in 159 msec 2023-02-08 07:03:24,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-08 07:03:24,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=26ebae38cbb4842d4e8475ee2397819b, UNASSIGN in 164 msec 2023-02-08 07:03:24,610 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839804610"}]},"ts":"1675839804610"} 2023-02-08 07:03:24,611 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-08 07:03:24,613 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-08 07:03:24,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 176 msec 2023-02-08 07:03:24,743 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:24,743 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:24,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 07:03:24,745 INFO [Listener at localhost/41689] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-08 07:03:24,745 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:24,745 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:24,746 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,748 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,748 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:24,749 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:24,749 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 07:03:24,752 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:24,753 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1, FileablePath, hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2, FileablePath, hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/recovered.edits] 2023-02-08 07:03:24,756 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1/97aa7380e5fd41e18d655747bb706858 to hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/archive/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1/97aa7380e5fd41e18d655747bb706858 2023-02-08 07:03:24,757 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1/d620542faefe4e5691d7146f762b38ad to hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/archive/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f1/d620542faefe4e5691d7146f762b38ad 2023-02-08 07:03:24,760 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2/068d4b1bf57b4a98b29b4794ee78dea3 to hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/archive/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2/068d4b1bf57b4a98b29b4794ee78dea3 2023-02-08 07:03:24,761 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2/2f49ca9dc9d94866ad2048df554f19a0 to hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/archive/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/f2/2f49ca9dc9d94866ad2048df554f19a0 2023-02-08 07:03:24,763 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/recovered.edits/12.seqid to hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/archive/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b/recovered.edits/12.seqid 2023-02-08 07:03:24,763 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/.tmp/data/default/testWithMockedMapReduceSingleRegion/26ebae38cbb4842d4e8475ee2397819b 2023-02-08 07:03:24,764 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-08 07:03:24,765 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,767 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-08 07:03:24,768 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-08 07:03:24,769 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,769 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-08 07:03:24,769 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839804769"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:24,770 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-08 07:03:24,770 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 26ebae38cbb4842d4e8475ee2397819b, NAME => 'testWithMockedMapReduceSingleRegion,,1675839802918.26ebae38cbb4842d4e8475ee2397819b.', STARTKEY => '', ENDKEY => ''}] 2023-02-08 07:03:24,770 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-08 07:03:24,770 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675839804770"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:24,771 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-08 07:03:24,773 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 07:03:24,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 27 msec 2023-02-08 07:03:24,850 INFO [Listener at localhost/41689] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:24,850 INFO [Listener at localhost/41689] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:24,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37609] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 07:03:24,851 INFO [Listener at localhost/41689] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-08 07:03:24,851 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 07:03:24,851 INFO [Listener at localhost/41689] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 07:03:24,851 DEBUG [Listener at localhost/41689] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40c50cb3 to 127.0.0.1:51950 2023-02-08 07:03:24,851 DEBUG [Listener at localhost/41689] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:24,852 DEBUG [Listener at localhost/41689] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 07:03:24,852 DEBUG [Listener at localhost/41689] util.JVMClusterUtil(257): Found active master hash=1937108910, stopped=false 2023-02-08 07:03:24,852 INFO [Listener at localhost/41689] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37609,1675839801394 2023-02-08 07:03:24,853 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:24,853 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:24,854 INFO [Listener at localhost/41689] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 07:03:24,853 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:24,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:24,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:24,855 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:24,856 DEBUG [Listener at localhost/41689] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x167008b6 to 127.0.0.1:51950 2023-02-08 07:03:24,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:24,856 DEBUG [Listener at localhost/41689] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:24,856 INFO [Listener at localhost/41689] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32827,1675839801444' ***** 2023-02-08 07:03:24,856 INFO [Listener at localhost/41689] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:03:24,856 INFO [Listener at localhost/41689] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38533,1675839801469' ***** 2023-02-08 07:03:24,856 INFO [Listener at localhost/41689] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:03:24,856 INFO [RS:0;jenkins-hbase4:32827] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:03:24,856 INFO [RS:1;jenkins-hbase4:38533] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:03:24,856 INFO [RS:0;jenkins-hbase4:32827] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:03:24,856 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:03:24,856 INFO [RS:1;jenkins-hbase4:38533] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:03:24,856 INFO [RS:0;jenkins-hbase4:32827] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:03:24,857 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:03:24,858 INFO [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:24,857 INFO [RS:1;jenkins-hbase4:38533] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:03:24,858 DEBUG [RS:0;jenkins-hbase4:32827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3565067e to 127.0.0.1:51950 2023-02-08 07:03:24,858 INFO [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(3304): Received CLOSE for 3518824ac5e95a753a969dcc0e89396b 2023-02-08 07:03:24,859 DEBUG [RS:0;jenkins-hbase4:32827] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:24,859 INFO [RS:0;jenkins-hbase4:32827] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:03:24,859 INFO [RS:0;jenkins-hbase4:32827] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:03:24,859 INFO [RS:0;jenkins-hbase4:32827] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:03:24,859 INFO [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:24,859 INFO [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 07:03:24,859 DEBUG [RS:1;jenkins-hbase4:38533] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b0787eb to 127.0.0.1:51950 2023-02-08 07:03:24,859 DEBUG [RS:1;jenkins-hbase4:38533] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:24,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3518824ac5e95a753a969dcc0e89396b, disabling compactions & flushes 2023-02-08 07:03:24,859 INFO [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 07:03:24,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. 2023-02-08 07:03:24,859 INFO [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 07:03:24,859 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:03:24,859 DEBUG [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(1479): Online Regions={3518824ac5e95a753a969dcc0e89396b=hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b.} 2023-02-08 07:03:24,859 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:03:24,859 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:03:24,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. 2023-02-08 07:03:24,859 DEBUG [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-08 07:03:24,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. after waiting 0 ms 2023-02-08 07:03:24,859 DEBUG [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 07:03:24,859 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:03:24,859 DEBUG [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(1505): Waiting on 3518824ac5e95a753a969dcc0e89396b 2023-02-08 07:03:24,859 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:03:24,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. 2023-02-08 07:03:24,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 3518824ac5e95a753a969dcc0e89396b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 07:03:24,860 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-08 07:03:24,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b/.tmp/info/4627e4e1f224402cace5c3551bdba8a7 2023-02-08 07:03:24,868 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/.tmp/info/01745bcbc9344bbaa5145a74e8767484 2023-02-08 07:03:24,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01745bcbc9344bbaa5145a74e8767484 2023-02-08 07:03:24,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b/.tmp/info/4627e4e1f224402cace5c3551bdba8a7 as hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b/info/4627e4e1f224402cace5c3551bdba8a7 2023-02-08 07:03:24,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b/info/4627e4e1f224402cace5c3551bdba8a7, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 07:03:24,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3518824ac5e95a753a969dcc0e89396b in 16ms, sequenceid=6, compaction requested=false 2023-02-08 07:03:24,882 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/.tmp/rep_barrier/70ec5c45bb4944f3be2c3172c6b9ae81 2023-02-08 07:03:24,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/namespace/3518824ac5e95a753a969dcc0e89396b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 07:03:24,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. 2023-02-08 07:03:24,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3518824ac5e95a753a969dcc0e89396b: Waiting for close lock at 1675839804859Running coprocessor pre-close hooks at 1675839804859Disabling compacts and flushes for region at 1675839804859Disabling writes for close at 1675839804859Obtaining lock to block concurrent updates at 1675839804860 (+1 ms)Preparing flush snapshotting stores in 3518824ac5e95a753a969dcc0e89396b at 1675839804860Finished memstore snapshotting hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675839804860Flushing stores of hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. at 1675839804860Flushing 3518824ac5e95a753a969dcc0e89396b/info: creating writer at 1675839804860Flushing 3518824ac5e95a753a969dcc0e89396b/info: appending metadata at 1675839804862 (+2 ms)Flushing 3518824ac5e95a753a969dcc0e89396b/info: closing flushed file at 1675839804862Flushing 3518824ac5e95a753a969dcc0e89396b/info: reopening flushed file at 1675839804872 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3518824ac5e95a753a969dcc0e89396b in 16ms, sequenceid=6, compaction requested=false at 1675839804876 (+4 ms)Writing region close event to WAL at 1675839804880 (+4 ms)Running coprocessor post-close hooks at 1675839804883 (+3 ms)Closed at 1675839804883 2023-02-08 07:03:24,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675839802432.3518824ac5e95a753a969dcc0e89396b. 2023-02-08 07:03:24,885 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70ec5c45bb4944f3be2c3172c6b9ae81 2023-02-08 07:03:24,892 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/.tmp/table/b24662e6f7914db2a71916b6064453f9 2023-02-08 07:03:24,895 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b24662e6f7914db2a71916b6064453f9 2023-02-08 07:03:24,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/.tmp/info/01745bcbc9344bbaa5145a74e8767484 as hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/info/01745bcbc9344bbaa5145a74e8767484 2023-02-08 07:03:24,898 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01745bcbc9344bbaa5145a74e8767484 2023-02-08 07:03:24,898 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/info/01745bcbc9344bbaa5145a74e8767484, entries=12, sequenceid=21, filesize=6.3 K 2023-02-08 07:03:24,899 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/.tmp/rep_barrier/70ec5c45bb4944f3be2c3172c6b9ae81 as hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/rep_barrier/70ec5c45bb4944f3be2c3172c6b9ae81 2023-02-08 07:03:24,903 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70ec5c45bb4944f3be2c3172c6b9ae81 2023-02-08 07:03:24,903 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/rep_barrier/70ec5c45bb4944f3be2c3172c6b9ae81, entries=1, sequenceid=21, filesize=5.0 K 2023-02-08 07:03:24,904 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/.tmp/table/b24662e6f7914db2a71916b6064453f9 as hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/table/b24662e6f7914db2a71916b6064453f9 2023-02-08 07:03:24,907 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b24662e6f7914db2a71916b6064453f9 2023-02-08 07:03:24,907 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/table/b24662e6f7914db2a71916b6064453f9, entries=4, sequenceid=21, filesize=5.1 K 2023-02-08 07:03:24,911 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 52ms, sequenceid=21, compaction requested=false 2023-02-08 07:03:24,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-08 07:03:24,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 07:03:24,914 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:24,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839804859Running coprocessor pre-close hooks at 1675839804859Disabling compacts and flushes for region at 1675839804859Disabling writes for close at 1675839804859Obtaining lock to block concurrent updates at 1675839804860 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1675839804860Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1675839804860Flushing stores of hbase:meta,,1.1588230740 at 1675839804860Flushing 1588230740/info: creating writer at 1675839804860Flushing 1588230740/info: appending metadata at 1675839804862 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675839804862Flushing 1588230740/rep_barrier: creating writer at 1675839804871 (+9 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675839804873 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675839804873Flushing 1588230740/table: creating writer at 1675839804886 (+13 ms)Flushing 1588230740/table: appending metadata at 1675839804887 (+1 ms)Flushing 1588230740/table: closing flushed file at 1675839804887Flushing 1588230740/info: reopening flushed file at 1675839804896 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675839804900 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675839804904 (+4 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 52ms, sequenceid=21, compaction requested=false at 1675839804911 (+7 ms)Writing region close event to WAL at 1675839804912 (+1 ms)Running coprocessor post-close hooks at 1675839804914 (+2 ms)Closed at 1675839804914 2023-02-08 07:03:24,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:24,949 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:24,949 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:25,059 INFO [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32827,1675839801444; all regions closed. 2023-02-08 07:03:25,060 INFO [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38533,1675839801469; all regions closed. 2023-02-08 07:03:25,064 DEBUG [RS:0;jenkins-hbase4:32827] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/oldWALs 2023-02-08 07:03:25,064 INFO [RS:0;jenkins-hbase4:32827] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32827%2C1675839801444.meta:.meta(num 1675839802374) 2023-02-08 07:03:25,064 DEBUG [RS:1;jenkins-hbase4:38533] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/oldWALs 2023-02-08 07:03:25,064 INFO [RS:1;jenkins-hbase4:38533] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38533%2C1675839801469:(num 1675839802774) 2023-02-08 07:03:25,064 DEBUG [RS:1;jenkins-hbase4:38533] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:25,064 INFO [RS:1;jenkins-hbase4:38533] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:25,064 INFO [RS:1;jenkins-hbase4:38533] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 07:03:25,064 INFO [RS:1;jenkins-hbase4:38533] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:03:25,064 INFO [RS:1;jenkins-hbase4:38533] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:03:25,064 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:25,064 INFO [RS:1;jenkins-hbase4:38533] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:03:25,066 INFO [RS:1;jenkins-hbase4:38533] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38533 2023-02-08 07:03:25,067 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:25,067 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38533,1675839801469 2023-02-08 07:03:25,067 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:25,067 ERROR [Listener at localhost/41689-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7edf34c2 rejected from java.util.concurrent.ThreadPoolExecutor@7ae0bfc1[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:25,067 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:25,068 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:25,068 ERROR [Listener at localhost/41689-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@969d8e8 rejected from java.util.concurrent.ThreadPoolExecutor@7ae0bfc1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:25,069 DEBUG [RS:0;jenkins-hbase4:32827] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/oldWALs 2023-02-08 07:03:25,069 INFO [RS:0;jenkins-hbase4:32827] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32827%2C1675839801444:(num 1675839802774) 2023-02-08 07:03:25,069 DEBUG [RS:0;jenkins-hbase4:32827] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:25,069 INFO [RS:0;jenkins-hbase4:32827] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:25,069 INFO [RS:0;jenkins-hbase4:32827] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 07:03:25,069 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:25,070 INFO [RS:0;jenkins-hbase4:32827] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32827 2023-02-08 07:03:25,073 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38533,1675839801469] 2023-02-08 07:03:25,073 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38533,1675839801469; numProcessing=1 2023-02-08 07:03:25,074 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:25,074 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32827,1675839801444 2023-02-08 07:03:25,074 ERROR [Listener at localhost/41689-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4743936a rejected from java.util.concurrent.ThreadPoolExecutor@437c1f5a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:25,075 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38533,1675839801469 already deleted, retry=false 2023-02-08 07:03:25,075 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38533,1675839801469 expired; onlineServers=1 2023-02-08 07:03:25,077 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32827,1675839801444] 2023-02-08 07:03:25,077 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32827,1675839801444; numProcessing=2 2023-02-08 07:03:25,079 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32827,1675839801444 already deleted, retry=false 2023-02-08 07:03:25,079 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32827,1675839801444 expired; onlineServers=0 2023-02-08 07:03:25,079 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37609,1675839801394' ***** 2023-02-08 07:03:25,079 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 07:03:25,080 DEBUG [M:0;jenkins-hbase4:37609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@774a6518, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:25,080 INFO [M:0;jenkins-hbase4:37609] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37609,1675839801394 2023-02-08 07:03:25,080 INFO [M:0;jenkins-hbase4:37609] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37609,1675839801394; all regions closed. 2023-02-08 07:03:25,080 DEBUG [M:0;jenkins-hbase4:37609] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:25,080 DEBUG [M:0;jenkins-hbase4:37609] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 07:03:25,080 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 07:03:25,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839801615] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839801615,5,FailOnTimeoutGroup] 2023-02-08 07:03:25,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839801615] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839801615,5,FailOnTimeoutGroup] 2023-02-08 07:03:25,080 DEBUG [M:0;jenkins-hbase4:37609] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 07:03:25,081 INFO [M:0;jenkins-hbase4:37609] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 07:03:25,081 INFO [M:0;jenkins-hbase4:37609] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 07:03:25,082 INFO [M:0;jenkins-hbase4:37609] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 07:03:25,082 DEBUG [M:0;jenkins-hbase4:37609] master.HMaster(1502): Stopping service threads 2023-02-08 07:03:25,082 INFO [M:0;jenkins-hbase4:37609] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 07:03:25,082 ERROR [M:0;jenkins-hbase4:37609] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-08 07:03:25,082 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:25,082 INFO [M:0;jenkins-hbase4:37609] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 07:03:25,082 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:25,083 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 07:03:25,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:25,083 DEBUG [M:0;jenkins-hbase4:37609] zookeeper.ZKUtil(398): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 07:03:25,083 WARN [M:0;jenkins-hbase4:37609] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 07:03:25,083 INFO [M:0;jenkins-hbase4:37609] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 07:03:25,084 INFO [M:0;jenkins-hbase4:37609] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 07:03:25,084 DEBUG [M:0;jenkins-hbase4:37609] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:03:25,084 INFO [M:0;jenkins-hbase4:37609] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:25,084 DEBUG [M:0;jenkins-hbase4:37609] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:25,084 DEBUG [M:0;jenkins-hbase4:37609] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:03:25,084 DEBUG [M:0;jenkins-hbase4:37609] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:25,084 INFO [M:0;jenkins-hbase4:37609] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.15 KB heapSize=67.07 KB 2023-02-08 07:03:25,093 INFO [M:0;jenkins-hbase4:37609] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.15 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1ec6ea13543d4dd5b7286d18fa246ccc 2023-02-08 07:03:25,098 DEBUG [M:0;jenkins-hbase4:37609] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1ec6ea13543d4dd5b7286d18fa246ccc as hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1ec6ea13543d4dd5b7286d18fa246ccc 2023-02-08 07:03:25,101 INFO [M:0;jenkins-hbase4:37609] regionserver.HStore(1080): Added hdfs://localhost:45671/user/jenkins/test-data/60bcdca6-f70a-9f53-93e8-c71496eb655b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1ec6ea13543d4dd5b7286d18fa246ccc, entries=17, sequenceid=132, filesize=8.7 K 2023-02-08 07:03:25,102 INFO [M:0;jenkins-hbase4:37609] regionserver.HRegion(2947): Finished flush of dataSize ~56.15 KB/57497, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-08 07:03:25,103 INFO [M:0;jenkins-hbase4:37609] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:25,103 DEBUG [M:0;jenkins-hbase4:37609] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839805084Disabling compacts and flushes for region at 1675839805084Disabling writes for close at 1675839805084Obtaining lock to block concurrent updates at 1675839805084Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675839805084Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57497, getHeapSize=68664, getOffHeapSize=0, getCellsCount=145 at 1675839805084Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675839805085 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675839805085Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675839805087 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675839805087Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675839805098 (+11 ms)Finished flush of dataSize ~56.15 KB/57497, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1675839805102 (+4 ms)Writing region close event to WAL at 1675839805103 (+1 ms)Closed at 1675839805103 2023-02-08 07:03:25,105 INFO [M:0;jenkins-hbase4:37609] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 07:03:25,105 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:25,106 INFO [M:0;jenkins-hbase4:37609] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37609 2023-02-08 07:03:25,109 DEBUG [M:0;jenkins-hbase4:37609] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37609,1675839801394 already deleted, retry=false 2023-02-08 07:03:25,356 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:25,356 INFO [M:0;jenkins-hbase4:37609] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37609,1675839801394; zookeeper connection closed. 2023-02-08 07:03:25,356 ERROR [Listener at localhost/41689-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c1b3ac7 rejected from java.util.concurrent.ThreadPoolExecutor@3824b99c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:25,357 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): master:37609-0x10032bdf1e10000, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:25,357 ERROR [Listener at localhost/41689-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2939c606 rejected from java.util.concurrent.ThreadPoolExecutor@3824b99c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:25,456 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:25,456 INFO [RS:0;jenkins-hbase4:32827] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32827,1675839801444; zookeeper connection closed. 2023-02-08 07:03:25,456 ERROR [Listener at localhost/41689-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6cb19890 rejected from java.util.concurrent.ThreadPoolExecutor@437c1f5a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:25,456 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1ff8ef5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1ff8ef5 2023-02-08 07:03:25,456 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:32827-0x10032bdf1e10001, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:25,456 ERROR [Listener at localhost/41689-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1417c1dc rejected from java.util.concurrent.ThreadPoolExecutor@437c1f5a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:25,487 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-08 07:03:25,556 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:25,556 INFO [RS:1;jenkins-hbase4:38533] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38533,1675839801469; zookeeper connection closed. 2023-02-08 07:03:25,556 ERROR [Listener at localhost/41689-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71f63c87 rejected from java.util.concurrent.ThreadPoolExecutor@7ae0bfc1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:25,556 DEBUG [Listener at localhost/41689-EventThread] zookeeper.ZKWatcher(600): regionserver:38533-0x10032bdf1e10002, quorum=127.0.0.1:51950, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:25,556 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@290d53e3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@290d53e3 2023-02-08 07:03:25,557 ERROR [Listener at localhost/41689-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1824ec3f rejected from java.util.concurrent.ThreadPoolExecutor@7ae0bfc1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:25,557 INFO [Listener at localhost/41689] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 07:03:25,557 WARN [Listener at localhost/41689] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:03:25,561 INFO [Listener at localhost/41689] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:25,666 WARN [BP-1741349169-172.31.14.131-1675839800809 heartbeating to localhost/127.0.0.1:45671] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:03:25,666 WARN [BP-1741349169-172.31.14.131-1675839800809 heartbeating to localhost/127.0.0.1:45671] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1741349169-172.31.14.131-1675839800809 (Datanode Uuid 1f28765a-f8ae-4d8c-9805-ab6c87061fdf) service to localhost/127.0.0.1:45671 2023-02-08 07:03:25,666 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/cluster_ba76cba8-4982-26c9-8f4f-6a37dcffc244/dfs/data/data3/current/BP-1741349169-172.31.14.131-1675839800809] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:25,667 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/cluster_ba76cba8-4982-26c9-8f4f-6a37dcffc244/dfs/data/data4/current/BP-1741349169-172.31.14.131-1675839800809] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:25,668 WARN [Listener at localhost/41689] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:03:25,671 INFO [Listener at localhost/41689] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:25,775 WARN [BP-1741349169-172.31.14.131-1675839800809 heartbeating to localhost/127.0.0.1:45671] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:03:25,775 WARN [BP-1741349169-172.31.14.131-1675839800809 heartbeating to localhost/127.0.0.1:45671] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1741349169-172.31.14.131-1675839800809 (Datanode Uuid 13a30156-d171-4b0a-a198-c77c2e7c7c67) service to localhost/127.0.0.1:45671 2023-02-08 07:03:25,776 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/cluster_ba76cba8-4982-26c9-8f4f-6a37dcffc244/dfs/data/data1/current/BP-1741349169-172.31.14.131-1675839800809] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:25,776 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/cluster_ba76cba8-4982-26c9-8f4f-6a37dcffc244/dfs/data/data2/current/BP-1741349169-172.31.14.131-1675839800809] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:25,787 INFO [Listener at localhost/41689] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:25,901 INFO [Listener at localhost/41689] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 07:03:25,921 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 07:03:25,932 INFO [Listener at localhost/41689] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=254 (was 231) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:45671 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41689 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45671 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:45671 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:45671 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:45671 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41689.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:45671 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:45671 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37609,1675839801394)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=664 (was 646) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=269 (was 275), ProcessCount=165 (was 165), AvailableMemoryMB=4204 (was 4280) 2023-02-08 07:03:25,943 INFO [Listener at localhost/41689] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=254, OpenFileDescriptor=664, MaxFileDescriptor=60000, SystemLoadAverage=269, ProcessCount=165, AvailableMemoryMB=4204 2023-02-08 07:03:25,952 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/hadoop.log.dir so I do NOT create it in target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530 2023-02-08 07:03:25,953 WARN [Listener at localhost/41689] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/hadoop.log.dir Erasing configuration value by system value. 2023-02-08 07:03:25,953 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/hadoop.tmp.dir so I do NOT create it in target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530 2023-02-08 07:03:25,953 WARN [Listener at localhost/41689] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ba839a4d-f39c-4702-3cfa-5547c296c11c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-08 07:03:25,953 DEBUG [Listener at localhost/41689] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530 2023-02-08 07:03:25,953 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 07:03:25,953 INFO [Listener at localhost/41689] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/cluster_6ae76a4e-d9e1-9db4-8a80-92b9d8a5bc92, deleteOnExit=true 2023-02-08 07:03:25,953 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 07:03:25,953 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/test.cache.data in system properties and HBase conf 2023-02-08 07:03:25,953 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 07:03:25,953 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/hadoop.log.dir in system properties and HBase conf 2023-02-08 07:03:25,953 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 07:03:25,954 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 07:03:25,954 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 07:03:25,954 DEBUG [Listener at localhost/41689] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 07:03:25,954 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:03:25,954 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:03:25,954 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 07:03:25,954 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:03:25,954 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 07:03:25,954 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 07:03:25,954 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:03:25,954 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:03:25,955 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 07:03:25,955 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/nfs.dump.dir in system properties and HBase conf 2023-02-08 07:03:25,955 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/java.io.tmpdir in system properties and HBase conf 2023-02-08 07:03:25,955 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:03:25,955 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 07:03:25,955 INFO [Listener at localhost/41689] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 07:03:25,959 WARN [Listener at localhost/41689] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:03:25,959 WARN [Listener at localhost/41689] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:03:25,998 WARN [Listener at localhost/41689] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:26,000 INFO [Listener at localhost/41689] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:26,004 INFO [Listener at localhost/41689] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/java.io.tmpdir/Jetty_localhost_36999_hdfs____.6b6f0g/webapp 2023-02-08 07:03:26,096 INFO [Listener at localhost/41689] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36999 2023-02-08 07:03:26,101 WARN [Listener at localhost/41689] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:03:26,101 WARN [Listener at localhost/41689] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:03:26,143 WARN [Listener at localhost/42793] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:26,156 WARN [Listener at localhost/42793] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:03:26,158 WARN [Listener at localhost/42793] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:26,159 INFO [Listener at localhost/42793] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:26,163 INFO [Listener at localhost/42793] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/java.io.tmpdir/Jetty_localhost_45393_datanode____qxzsr7/webapp 2023-02-08 07:03:26,254 INFO [Listener at localhost/42793] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45393 2023-02-08 07:03:26,262 WARN [Listener at localhost/42801] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:26,279 WARN [Listener at localhost/42801] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:03:26,283 WARN [Listener at localhost/42801] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:26,285 INFO [Listener at localhost/42801] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:26,290 INFO [Listener at localhost/42801] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/java.io.tmpdir/Jetty_localhost_38491_datanode____dvbh2m/webapp 2023-02-08 07:03:26,366 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28b096e130b96998: Processing first storage report for DS-d71550ef-c4e2-41ef-a5d4-edee3a6bcbf2 from datanode 37a4935c-f930-4937-afb5-780c0b1b0bfe 2023-02-08 07:03:26,366 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28b096e130b96998: from storage DS-d71550ef-c4e2-41ef-a5d4-edee3a6bcbf2 node DatanodeRegistration(127.0.0.1:37915, datanodeUuid=37a4935c-f930-4937-afb5-780c0b1b0bfe, infoPort=42321, infoSecurePort=0, ipcPort=42801, storageInfo=lv=-57;cid=testClusterID;nsid=1829019766;c=1675839805962), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:26,366 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28b096e130b96998: Processing first storage report for DS-94d82446-6a6c-4679-bc2f-769c292460bd from datanode 37a4935c-f930-4937-afb5-780c0b1b0bfe 2023-02-08 07:03:26,366 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28b096e130b96998: from storage DS-94d82446-6a6c-4679-bc2f-769c292460bd node DatanodeRegistration(127.0.0.1:37915, datanodeUuid=37a4935c-f930-4937-afb5-780c0b1b0bfe, infoPort=42321, infoSecurePort=0, ipcPort=42801, storageInfo=lv=-57;cid=testClusterID;nsid=1829019766;c=1675839805962), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:26,390 INFO [Listener at localhost/42801] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38491 2023-02-08 07:03:26,397 WARN [Listener at localhost/40499] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:26,489 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb87da9783ba783f7: Processing first storage report for DS-7c2983d4-f915-4c37-8bba-da5d6bb50043 from datanode 57426afc-334c-4373-8c60-59faec1fda1d 2023-02-08 07:03:26,489 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb87da9783ba783f7: from storage DS-7c2983d4-f915-4c37-8bba-da5d6bb50043 node DatanodeRegistration(127.0.0.1:45729, datanodeUuid=57426afc-334c-4373-8c60-59faec1fda1d, infoPort=35459, infoSecurePort=0, ipcPort=40499, storageInfo=lv=-57;cid=testClusterID;nsid=1829019766;c=1675839805962), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:26,489 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb87da9783ba783f7: Processing first storage report for DS-807654b6-0f5b-444b-97ca-94ee101fa59f from datanode 57426afc-334c-4373-8c60-59faec1fda1d 2023-02-08 07:03:26,489 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb87da9783ba783f7: from storage DS-807654b6-0f5b-444b-97ca-94ee101fa59f node DatanodeRegistration(127.0.0.1:45729, datanodeUuid=57426afc-334c-4373-8c60-59faec1fda1d, infoPort=35459, infoSecurePort=0, ipcPort=40499, storageInfo=lv=-57;cid=testClusterID;nsid=1829019766;c=1675839805962), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:26,507 DEBUG [Listener at localhost/40499] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530 2023-02-08 07:03:26,508 INFO [Listener at localhost/40499] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/cluster_6ae76a4e-d9e1-9db4-8a80-92b9d8a5bc92/zookeeper_0, clientPort=63226, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/cluster_6ae76a4e-d9e1-9db4-8a80-92b9d8a5bc92/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/cluster_6ae76a4e-d9e1-9db4-8a80-92b9d8a5bc92/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 07:03:26,509 INFO [Listener at localhost/40499] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63226 2023-02-08 07:03:26,510 INFO [Listener at localhost/40499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:26,510 INFO [Listener at localhost/40499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:26,529 INFO [Listener at localhost/40499] util.FSUtils(479): Created version file at hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6 with version=8 2023-02-08 07:03:26,529 INFO [Listener at localhost/40499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:26,530 INFO [Listener at localhost/40499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:26,531 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42793/user/jenkins/test-data/ad3f8bfa-4267-02e3-5e8f-eaf69f7f4151/hbase-staging 2023-02-08 07:03:26,533 INFO [Listener at localhost/40499] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:26,534 INFO [Listener at localhost/40499] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:26,534 INFO [Listener at localhost/40499] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:26,534 INFO [Listener at localhost/40499] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:26,534 INFO [Listener at localhost/40499] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:26,534 INFO [Listener at localhost/40499] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:26,534 INFO [Listener at localhost/40499] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:26,535 INFO [Listener at localhost/40499] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37997 2023-02-08 07:03:26,536 INFO [Listener at localhost/40499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:26,537 INFO [Listener at localhost/40499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:26,538 INFO [Listener at localhost/40499] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37997 connecting to ZooKeeper ensemble=127.0.0.1:63226 2023-02-08 07:03:26,549 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:379970x0, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:26,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37997-0x10032be05f10000 connected 2023-02-08 07:03:26,576 DEBUG [Listener at localhost/40499] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:26,576 DEBUG [Listener at localhost/40499] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:26,577 DEBUG [Listener at localhost/40499] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:26,579 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37997 2023-02-08 07:03:26,580 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37997 2023-02-08 07:03:26,580 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37997 2023-02-08 07:03:26,584 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37997 2023-02-08 07:03:26,584 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37997 2023-02-08 07:03:26,584 INFO [Listener at localhost/40499] master.HMaster(439): hbase.rootdir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6, hbase.cluster.distributed=false 2023-02-08 07:03:26,596 INFO [Listener at localhost/40499] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:26,596 INFO [Listener at localhost/40499] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:26,596 INFO [Listener at localhost/40499] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:26,596 INFO [Listener at localhost/40499] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:26,596 INFO [Listener at localhost/40499] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:26,596 INFO [Listener at localhost/40499] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:26,596 INFO [Listener at localhost/40499] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:26,597 INFO [Listener at localhost/40499] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38691 2023-02-08 07:03:26,597 INFO [Listener at localhost/40499] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:03:26,598 DEBUG [Listener at localhost/40499] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:26,598 INFO [Listener at localhost/40499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:26,599 INFO [Listener at localhost/40499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:26,600 INFO [Listener at localhost/40499] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38691 connecting to ZooKeeper ensemble=127.0.0.1:63226 2023-02-08 07:03:26,603 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:386910x0, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:26,604 DEBUG [Listener at localhost/40499] zookeeper.ZKUtil(164): regionserver:386910x0, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:26,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38691-0x10032be05f10001 connected 2023-02-08 07:03:26,604 DEBUG [Listener at localhost/40499] zookeeper.ZKUtil(164): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:26,605 DEBUG [Listener at localhost/40499] zookeeper.ZKUtil(164): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:26,609 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38691 2023-02-08 07:03:26,609 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38691 2023-02-08 07:03:26,609 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38691 2023-02-08 07:03:26,610 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38691 2023-02-08 07:03:26,610 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38691 2023-02-08 07:03:26,620 INFO [Listener at localhost/40499] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:26,620 INFO [Listener at localhost/40499] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:26,620 INFO [Listener at localhost/40499] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:26,620 INFO [Listener at localhost/40499] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:26,620 INFO [Listener at localhost/40499] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:26,620 INFO [Listener at localhost/40499] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:26,620 INFO [Listener at localhost/40499] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:26,624 INFO [Listener at localhost/40499] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42571 2023-02-08 07:03:26,624 INFO [Listener at localhost/40499] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:03:26,625 DEBUG [Listener at localhost/40499] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:26,625 INFO [Listener at localhost/40499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:26,626 INFO [Listener at localhost/40499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:26,627 INFO [Listener at localhost/40499] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42571 connecting to ZooKeeper ensemble=127.0.0.1:63226 2023-02-08 07:03:26,629 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:425710x0, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:26,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42571-0x10032be05f10002 connected 2023-02-08 07:03:26,630 DEBUG [Listener at localhost/40499] zookeeper.ZKUtil(164): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:26,630 DEBUG [Listener at localhost/40499] zookeeper.ZKUtil(164): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:26,631 DEBUG [Listener at localhost/40499] zookeeper.ZKUtil(164): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:26,632 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42571 2023-02-08 07:03:26,634 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42571 2023-02-08 07:03:26,634 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42571 2023-02-08 07:03:26,635 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42571 2023-02-08 07:03:26,635 DEBUG [Listener at localhost/40499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42571 2023-02-08 07:03:26,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37997,1675839806533 2023-02-08 07:03:26,638 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:03:26,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37997,1675839806533 2023-02-08 07:03:26,639 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:26,639 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:26,640 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:26,640 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:26,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:03:26,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37997,1675839806533 from backup master directory 2023-02-08 07:03:26,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:03:26,645 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37997,1675839806533 2023-02-08 07:03:26,645 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:03:26,645 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:26,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37997,1675839806533 2023-02-08 07:03:26,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/hbase.id with ID: 42744e4f-dc55-4793-abf9-c16eaa0b29eb 2023-02-08 07:03:26,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:26,674 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:26,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x06aaf922 to 127.0.0.1:63226 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:26,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5985b57c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:26,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:26,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 07:03:26,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:26,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/data/master/store-tmp 2023-02-08 07:03:26,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:26,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:03:26,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:26,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:26,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:03:26,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:26,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:26,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839806700Disabling compacts and flushes for region at 1675839806700Disabling writes for close at 1675839806700Writing region close event to WAL at 1675839806700Closed at 1675839806700 2023-02-08 07:03:26,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/WALs/jenkins-hbase4.apache.org,37997,1675839806533 2023-02-08 07:03:26,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37997%2C1675839806533, suffix=, logDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/WALs/jenkins-hbase4.apache.org,37997,1675839806533, archiveDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/oldWALs, maxLogs=10 2023-02-08 07:03:26,714 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37915,DS-d71550ef-c4e2-41ef-a5d4-edee3a6bcbf2,DISK] 2023-02-08 07:03:26,714 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45729,DS-7c2983d4-f915-4c37-8bba-da5d6bb50043,DISK] 2023-02-08 07:03:26,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/WALs/jenkins-hbase4.apache.org,37997,1675839806533/jenkins-hbase4.apache.org%2C37997%2C1675839806533.1675839806702 2023-02-08 07:03:26,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37915,DS-d71550ef-c4e2-41ef-a5d4-edee3a6bcbf2,DISK], DatanodeInfoWithStorage[127.0.0.1:45729,DS-7c2983d4-f915-4c37-8bba-da5d6bb50043,DISK]] 2023-02-08 07:03:26,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:26,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:26,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:26,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:26,717 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:26,718 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 07:03:26,718 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 07:03:26,719 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:26,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:26,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:26,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:26,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:26,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63492460, jitterRate=-0.05388861894607544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:03:26,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675839806716Initializing all the Stores at 1675839806717 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839806717Cleaning up temporary data from old regions at 1675839806720 (+3 ms)Cleaning up detritus from prior splits at 1675839806720Region opened successfully at 1675839806723 (+3 ms) 2023-02-08 07:03:26,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 07:03:26,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 07:03:26,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 07:03:26,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 07:03:26,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-08 07:03:26,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-08 07:03:26,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 07:03:26,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 07:03:26,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 07:03:26,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 07:03:26,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 07:03:26,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 07:03:26,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 07:03:26,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 07:03:26,738 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:26,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 07:03:26,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 07:03:26,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 07:03:26,742 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:26,742 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:26,742 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:26,742 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:26,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37997,1675839806533, sessionid=0x10032be05f10000, setting cluster-up flag (Was=false) 2023-02-08 07:03:26,747 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:26,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 07:03:26,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37997,1675839806533 2023-02-08 07:03:26,754 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:26,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 07:03:26,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37997,1675839806533 2023-02-08 07:03:26,759 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.hbase-snapshot/.tmp 2023-02-08 07:03:26,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:26,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:26,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:26,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:26,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:26,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 07:03:26,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:26,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675839836763 2023-02-08 07:03:26,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 07:03:26,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 07:03:26,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 07:03:26,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 07:03:26,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 07:03:26,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 07:03:26,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,763 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:26,763 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 07:03:26,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 07:03:26,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 07:03:26,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 07:03:26,765 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:26,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 07:03:26,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 07:03:26,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839806769,5,FailOnTimeoutGroup] 2023-02-08 07:03:26,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839806769,5,FailOnTimeoutGroup] 2023-02-08 07:03:26,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 07:03:26,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,774 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:26,775 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:26,775 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6 2023-02-08 07:03:26,784 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:26,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:03:26,789 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/info 2023-02-08 07:03:26,789 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:03:26,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:26,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:03:26,791 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:26,791 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:03:26,791 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:26,791 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:03:26,792 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/table 2023-02-08 07:03:26,792 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:03:26,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:26,793 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740 2023-02-08 07:03:26,793 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740 2023-02-08 07:03:26,795 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:03:26,795 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:03:26,797 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:26,797 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66758147, jitterRate=-0.0052260905504226685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:03:26,798 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675839806785Initializing all the Stores at 1675839806785Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839806785Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839806788 (+3 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839806788Cleaning up temporary data from old regions at 1675839806794 (+6 ms)Cleaning up detritus from prior splits at 1675839806794Region opened successfully at 1675839806798 (+4 ms) 2023-02-08 07:03:26,798 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:03:26,798 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:03:26,798 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:03:26,798 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:03:26,798 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:03:26,798 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:26,798 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839806798Disabling compacts and flushes for region at 1675839806798Disabling writes for close at 1675839806798Writing region close event to WAL at 1675839806798Closed at 1675839806798 2023-02-08 07:03:26,799 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:26,799 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 07:03:26,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 07:03:26,801 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 07:03:26,802 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 07:03:26,837 INFO [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(952): ClusterId : 42744e4f-dc55-4793-abf9-c16eaa0b29eb 2023-02-08 07:03:26,837 INFO [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(952): ClusterId : 42744e4f-dc55-4793-abf9-c16eaa0b29eb 2023-02-08 07:03:26,837 DEBUG [RS:1;jenkins-hbase4:42571] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:03:26,837 DEBUG [RS:0;jenkins-hbase4:38691] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:03:26,839 DEBUG [RS:1;jenkins-hbase4:42571] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:03:26,839 DEBUG [RS:1;jenkins-hbase4:42571] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:03:26,839 DEBUG [RS:0;jenkins-hbase4:38691] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:03:26,839 DEBUG [RS:0;jenkins-hbase4:38691] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:03:26,842 DEBUG [RS:1;jenkins-hbase4:42571] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:03:26,843 DEBUG [RS:0;jenkins-hbase4:38691] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:03:26,843 DEBUG [RS:1;jenkins-hbase4:42571] zookeeper.ReadOnlyZKClient(139): Connect 0x02595cdf to 127.0.0.1:63226 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:26,844 DEBUG [RS:0;jenkins-hbase4:38691] zookeeper.ReadOnlyZKClient(139): Connect 0x6a83a7c1 to 127.0.0.1:63226 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:26,846 DEBUG [RS:0;jenkins-hbase4:38691] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@644454e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:26,846 DEBUG [RS:1;jenkins-hbase4:42571] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c9eb2e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:26,846 DEBUG [RS:0;jenkins-hbase4:38691] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@607bccb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:26,846 DEBUG [RS:1;jenkins-hbase4:42571] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8a137af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:26,859 DEBUG [RS:0;jenkins-hbase4:38691] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38691 2023-02-08 07:03:26,859 DEBUG [RS:1;jenkins-hbase4:42571] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42571 2023-02-08 07:03:26,859 INFO [RS:0;jenkins-hbase4:38691] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:03:26,860 INFO [RS:0;jenkins-hbase4:38691] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:03:26,859 INFO [RS:1;jenkins-hbase4:42571] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:03:26,860 INFO [RS:1;jenkins-hbase4:42571] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:03:26,860 DEBUG [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:03:26,860 DEBUG [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:03:26,860 INFO [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37997,1675839806533 with isa=jenkins-hbase4.apache.org/172.31.14.131:42571, startcode=1675839806620 2023-02-08 07:03:26,860 INFO [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37997,1675839806533 with isa=jenkins-hbase4.apache.org/172.31.14.131:38691, startcode=1675839806595 2023-02-08 07:03:26,860 DEBUG [RS:1;jenkins-hbase4:42571] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:03:26,860 DEBUG [RS:0;jenkins-hbase4:38691] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:03:26,862 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59055, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:03:26,862 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43465, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:03:26,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37997] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:26,864 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:26,865 DEBUG [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6 2023-02-08 07:03:26,865 DEBUG [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42793 2023-02-08 07:03:26,865 DEBUG [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6 2023-02-08 07:03:26,865 DEBUG [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:03:26,865 DEBUG [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42793 2023-02-08 07:03:26,865 DEBUG [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:03:26,869 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:26,870 DEBUG [RS:0;jenkins-hbase4:38691] zookeeper.ZKUtil(162): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:26,870 DEBUG [RS:1;jenkins-hbase4:42571] zookeeper.ZKUtil(162): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:26,870 WARN [RS:0;jenkins-hbase4:38691] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:26,870 WARN [RS:1;jenkins-hbase4:42571] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:26,870 INFO [RS:0;jenkins-hbase4:38691] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:26,870 INFO [RS:1;jenkins-hbase4:42571] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:26,870 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38691,1675839806595] 2023-02-08 07:03:26,870 DEBUG [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/WALs/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:26,870 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42571,1675839806620] 2023-02-08 07:03:26,870 DEBUG [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/WALs/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:26,874 DEBUG [RS:0;jenkins-hbase4:38691] zookeeper.ZKUtil(162): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:26,874 DEBUG [RS:1;jenkins-hbase4:42571] zookeeper.ZKUtil(162): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:26,874 DEBUG [RS:0;jenkins-hbase4:38691] zookeeper.ZKUtil(162): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:26,874 DEBUG [RS:1;jenkins-hbase4:42571] zookeeper.ZKUtil(162): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:26,875 DEBUG [RS:0;jenkins-hbase4:38691] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:03:26,875 INFO [RS:0;jenkins-hbase4:38691] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:03:26,875 DEBUG [RS:1;jenkins-hbase4:42571] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:03:26,877 INFO [RS:1;jenkins-hbase4:42571] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:03:26,877 INFO [RS:0;jenkins-hbase4:38691] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:03:26,877 INFO [RS:0;jenkins-hbase4:38691] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:03:26,877 INFO [RS:0;jenkins-hbase4:38691] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,877 INFO [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:03:26,878 INFO [RS:0;jenkins-hbase4:38691] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,879 DEBUG [RS:0;jenkins-hbase4:38691] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,879 DEBUG [RS:0;jenkins-hbase4:38691] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,879 DEBUG [RS:0;jenkins-hbase4:38691] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,879 DEBUG [RS:0;jenkins-hbase4:38691] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,879 DEBUG [RS:0;jenkins-hbase4:38691] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,879 DEBUG [RS:0;jenkins-hbase4:38691] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:26,879 DEBUG [RS:0;jenkins-hbase4:38691] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,880 DEBUG [RS:0;jenkins-hbase4:38691] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,880 DEBUG [RS:0;jenkins-hbase4:38691] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,880 DEBUG [RS:0;jenkins-hbase4:38691] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,883 INFO [RS:1;jenkins-hbase4:42571] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:03:26,885 INFO [RS:0;jenkins-hbase4:38691] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,885 INFO [RS:1;jenkins-hbase4:42571] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:03:26,885 INFO [RS:0;jenkins-hbase4:38691] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,885 INFO [RS:1;jenkins-hbase4:42571] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,885 INFO [RS:0;jenkins-hbase4:38691] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,886 INFO [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:03:26,887 INFO [RS:1;jenkins-hbase4:42571] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,887 DEBUG [RS:1;jenkins-hbase4:42571] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,887 DEBUG [RS:1;jenkins-hbase4:42571] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,887 DEBUG [RS:1;jenkins-hbase4:42571] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,887 DEBUG [RS:1;jenkins-hbase4:42571] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,887 DEBUG [RS:1;jenkins-hbase4:42571] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,887 DEBUG [RS:1;jenkins-hbase4:42571] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:26,887 DEBUG [RS:1;jenkins-hbase4:42571] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,887 DEBUG [RS:1;jenkins-hbase4:42571] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,887 DEBUG [RS:1;jenkins-hbase4:42571] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,888 DEBUG [RS:1;jenkins-hbase4:42571] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:26,892 INFO [RS:1;jenkins-hbase4:42571] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,892 INFO [RS:1;jenkins-hbase4:42571] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,892 INFO [RS:1;jenkins-hbase4:42571] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,902 INFO [RS:1;jenkins-hbase4:42571] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:03:26,902 INFO [RS:1;jenkins-hbase4:42571] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42571,1675839806620-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,904 INFO [RS:0;jenkins-hbase4:38691] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:03:26,904 INFO [RS:0;jenkins-hbase4:38691] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38691,1675839806595-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:26,920 INFO [RS:1;jenkins-hbase4:42571] regionserver.Replication(203): jenkins-hbase4.apache.org,42571,1675839806620 started 2023-02-08 07:03:26,920 INFO [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42571,1675839806620, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42571, sessionid=0x10032be05f10002 2023-02-08 07:03:26,924 INFO [RS:0;jenkins-hbase4:38691] regionserver.Replication(203): jenkins-hbase4.apache.org,38691,1675839806595 started 2023-02-08 07:03:26,924 DEBUG [RS:1;jenkins-hbase4:42571] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:03:26,924 DEBUG [RS:1;jenkins-hbase4:42571] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:26,924 DEBUG [RS:1;jenkins-hbase4:42571] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42571,1675839806620' 2023-02-08 07:03:26,924 DEBUG [RS:1;jenkins-hbase4:42571] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:26,924 INFO [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38691,1675839806595, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38691, sessionid=0x10032be05f10001 2023-02-08 07:03:26,924 DEBUG [RS:0;jenkins-hbase4:38691] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:03:26,924 DEBUG [RS:0;jenkins-hbase4:38691] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:26,924 DEBUG [RS:0;jenkins-hbase4:38691] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38691,1675839806595' 2023-02-08 07:03:26,924 DEBUG [RS:0;jenkins-hbase4:38691] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:26,924 DEBUG [RS:1;jenkins-hbase4:42571] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:26,925 DEBUG [RS:0;jenkins-hbase4:38691] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:26,925 DEBUG [RS:1;jenkins-hbase4:42571] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:03:26,925 DEBUG [RS:1;jenkins-hbase4:42571] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:03:26,925 DEBUG [RS:1;jenkins-hbase4:42571] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:26,925 DEBUG [RS:1;jenkins-hbase4:42571] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42571,1675839806620' 2023-02-08 07:03:26,925 DEBUG [RS:1;jenkins-hbase4:42571] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:26,925 DEBUG [RS:0;jenkins-hbase4:38691] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:03:26,925 DEBUG [RS:0;jenkins-hbase4:38691] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:03:26,925 DEBUG [RS:0;jenkins-hbase4:38691] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:26,925 DEBUG [RS:0;jenkins-hbase4:38691] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38691,1675839806595' 2023-02-08 07:03:26,925 DEBUG [RS:0;jenkins-hbase4:38691] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:26,925 DEBUG [RS:1;jenkins-hbase4:42571] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:26,925 DEBUG [RS:0;jenkins-hbase4:38691] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:26,926 DEBUG [RS:1;jenkins-hbase4:42571] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:03:26,926 INFO [RS:1;jenkins-hbase4:42571] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:03:26,926 INFO [RS:1;jenkins-hbase4:42571] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:03:26,926 DEBUG [RS:0;jenkins-hbase4:38691] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:03:26,926 INFO [RS:0;jenkins-hbase4:38691] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:03:26,926 INFO [RS:0;jenkins-hbase4:38691] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:03:26,952 DEBUG [jenkins-hbase4:37997] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 07:03:26,952 DEBUG [jenkins-hbase4:37997] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:26,953 DEBUG [jenkins-hbase4:37997] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:26,953 DEBUG [jenkins-hbase4:37997] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:26,953 DEBUG [jenkins-hbase4:37997] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:26,954 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38691,1675839806595, state=OPENING 2023-02-08 07:03:26,955 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 07:03:26,956 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:26,956 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:03:26,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38691,1675839806595}] 2023-02-08 07:03:27,111 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:27,111 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:03:27,113 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47090, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:03:27,116 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 07:03:27,116 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:27,118 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38691%2C1675839806595.meta, suffix=.meta, logDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/WALs/jenkins-hbase4.apache.org,38691,1675839806595, archiveDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/oldWALs, maxLogs=32 2023-02-08 07:03:27,131 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37915,DS-d71550ef-c4e2-41ef-a5d4-edee3a6bcbf2,DISK] 2023-02-08 07:03:27,131 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45729,DS-7c2983d4-f915-4c37-8bba-da5d6bb50043,DISK] 2023-02-08 07:03:27,133 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/WALs/jenkins-hbase4.apache.org,38691,1675839806595/jenkins-hbase4.apache.org%2C38691%2C1675839806595.meta.1675839807118.meta 2023-02-08 07:03:27,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37915,DS-d71550ef-c4e2-41ef-a5d4-edee3a6bcbf2,DISK], DatanodeInfoWithStorage[127.0.0.1:45729,DS-7c2983d4-f915-4c37-8bba-da5d6bb50043,DISK]] 2023-02-08 07:03:27,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:27,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 07:03:27,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 07:03:27,133 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 07:03:27,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 07:03:27,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:27,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 07:03:27,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 07:03:27,134 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:03:27,135 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/info 2023-02-08 07:03:27,135 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/info 2023-02-08 07:03:27,136 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:03:27,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:27,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:03:27,137 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:27,137 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:27,137 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:03:27,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:27,138 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:03:27,138 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/table 2023-02-08 07:03:27,138 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/table 2023-02-08 07:03:27,138 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:03:27,139 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:27,139 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740 2023-02-08 07:03:27,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740 2023-02-08 07:03:27,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:03:27,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:03:27,143 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73974296, jitterRate=0.1023029088973999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:03:27,143 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675839807134Writing region info on filesystem at 1675839807134Initializing all the Stores at 1675839807134Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839807134Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839807134Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839807134Cleaning up temporary data from old regions at 1675839807141 (+7 ms)Cleaning up detritus from prior splits at 1675839807141Running coprocessor post-open hooks at 1675839807143 (+2 ms)Region opened successfully at 1675839807143 2023-02-08 07:03:27,144 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675839807111 2023-02-08 07:03:27,147 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 07:03:27,147 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 07:03:27,148 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38691,1675839806595, state=OPEN 2023-02-08 07:03:27,149 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 07:03:27,149 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:03:27,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 07:03:27,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38691,1675839806595 in 193 msec 2023-02-08 07:03:27,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 07:03:27,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 351 msec 2023-02-08 07:03:27,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 392 msec 2023-02-08 07:03:27,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675839806638, completionTime=-1 2023-02-08 07:03:27,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 07:03:27,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 07:03:27,155 DEBUG [hconnection-0x3393890d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:27,156 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47096, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:27,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 07:03:27,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675839867158 2023-02-08 07:03:27,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675839927158 2023-02-08 07:03:27,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-08 07:03:27,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37997,1675839806533-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:27,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37997,1675839806533-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:27,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37997,1675839806533-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:27,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37997, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:27,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:27,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 07:03:27,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:27,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 07:03:27,168 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 07:03:27,169 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:03:27,169 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:03:27,170 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e 2023-02-08 07:03:27,171 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e empty. 2023-02-08 07:03:27,171 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e 2023-02-08 07:03:27,171 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 07:03:27,181 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:27,182 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 18ea901fabfdd3caef7c9b4eb069fc9e, NAME => 'hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp 2023-02-08 07:03:27,190 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:27,190 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 18ea901fabfdd3caef7c9b4eb069fc9e, disabling compactions & flushes 2023-02-08 07:03:27,190 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. 2023-02-08 07:03:27,191 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. 2023-02-08 07:03:27,191 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. after waiting 0 ms 2023-02-08 07:03:27,191 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. 2023-02-08 07:03:27,191 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. 2023-02-08 07:03:27,191 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 18ea901fabfdd3caef7c9b4eb069fc9e: Waiting for close lock at 1675839807190Disabling compacts and flushes for region at 1675839807190Disabling writes for close at 1675839807191 (+1 ms)Writing region close event to WAL at 1675839807191Closed at 1675839807191 2023-02-08 07:03:27,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:03:27,193 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839807193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839807193"}]},"ts":"1675839807193"} 2023-02-08 07:03:27,194 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 07:03:27,194 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:03:27,195 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839807195"}]},"ts":"1675839807195"} 2023-02-08 07:03:27,195 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 07:03:27,198 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:27,198 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:27,198 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:27,198 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:27,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=18ea901fabfdd3caef7c9b4eb069fc9e, ASSIGN}] 2023-02-08 07:03:27,201 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=18ea901fabfdd3caef7c9b4eb069fc9e, ASSIGN 2023-02-08 07:03:27,201 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=18ea901fabfdd3caef7c9b4eb069fc9e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42571,1675839806620; forceNewPlan=false, retain=false 2023-02-08 07:03:27,351 INFO [jenkins-hbase4:37997] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 07:03:27,352 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=18ea901fabfdd3caef7c9b4eb069fc9e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:27,352 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839807352"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839807352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839807352"}]},"ts":"1675839807352"} 2023-02-08 07:03:27,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 18ea901fabfdd3caef7c9b4eb069fc9e, server=jenkins-hbase4.apache.org,42571,1675839806620}] 2023-02-08 07:03:27,506 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:27,506 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:03:27,507 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:03:27,513 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. 2023-02-08 07:03:27,514 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42571%2C1675839806620, suffix=, logDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/WALs/jenkins-hbase4.apache.org,42571,1675839806620, archiveDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/oldWALs, maxLogs=32 2023-02-08 07:03:27,527 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45729,DS-7c2983d4-f915-4c37-8bba-da5d6bb50043,DISK] 2023-02-08 07:03:27,527 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37915,DS-d71550ef-c4e2-41ef-a5d4-edee3a6bcbf2,DISK] 2023-02-08 07:03:27,529 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/WALs/jenkins-hbase4.apache.org,42571,1675839806620/jenkins-hbase4.apache.org%2C42571%2C1675839806620.1675839807514 2023-02-08 07:03:27,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45729,DS-7c2983d4-f915-4c37-8bba-da5d6bb50043,DISK], DatanodeInfoWithStorage[127.0.0.1:37915,DS-d71550ef-c4e2-41ef-a5d4-edee3a6bcbf2,DISK]] 2023-02-08 07:03:27,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 18ea901fabfdd3caef7c9b4eb069fc9e, NAME => 'hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:27,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 18ea901fabfdd3caef7c9b4eb069fc9e 2023-02-08 07:03:27,530 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:27,530 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 18ea901fabfdd3caef7c9b4eb069fc9e 2023-02-08 07:03:27,530 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 18ea901fabfdd3caef7c9b4eb069fc9e 2023-02-08 07:03:27,531 INFO [StoreOpener-18ea901fabfdd3caef7c9b4eb069fc9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 18ea901fabfdd3caef7c9b4eb069fc9e 2023-02-08 07:03:27,532 DEBUG [StoreOpener-18ea901fabfdd3caef7c9b4eb069fc9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e/info 2023-02-08 07:03:27,532 DEBUG [StoreOpener-18ea901fabfdd3caef7c9b4eb069fc9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e/info 2023-02-08 07:03:27,532 INFO [StoreOpener-18ea901fabfdd3caef7c9b4eb069fc9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18ea901fabfdd3caef7c9b4eb069fc9e columnFamilyName info 2023-02-08 07:03:27,532 INFO [StoreOpener-18ea901fabfdd3caef7c9b4eb069fc9e-1] regionserver.HStore(310): Store=18ea901fabfdd3caef7c9b4eb069fc9e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:27,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e 2023-02-08 07:03:27,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e 2023-02-08 07:03:27,536 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 18ea901fabfdd3caef7c9b4eb069fc9e 2023-02-08 07:03:27,538 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:27,538 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 18ea901fabfdd3caef7c9b4eb069fc9e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73529344, jitterRate=0.095672607421875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:03:27,538 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 18ea901fabfdd3caef7c9b4eb069fc9e: Running coprocessor pre-open hook at 1675839807530Writing region info on filesystem at 1675839807530Initializing all the Stores at 1675839807530Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839807530Cleaning up temporary data from old regions at 1675839807534 (+4 ms)Cleaning up detritus from prior splits at 1675839807535 (+1 ms)Running coprocessor post-open hooks at 1675839807538 (+3 ms)Region opened successfully at 1675839807538 2023-02-08 07:03:27,539 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e., pid=6, masterSystemTime=1675839807506 2023-02-08 07:03:27,542 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. 2023-02-08 07:03:27,543 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. 2023-02-08 07:03:27,543 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=18ea901fabfdd3caef7c9b4eb069fc9e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:27,543 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839807543"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839807543"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839807543"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839807543"}]},"ts":"1675839807543"} 2023-02-08 07:03:27,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 07:03:27,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 18ea901fabfdd3caef7c9b4eb069fc9e, server=jenkins-hbase4.apache.org,42571,1675839806620 in 191 msec 2023-02-08 07:03:27,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 07:03:27,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=18ea901fabfdd3caef7c9b4eb069fc9e, ASSIGN in 347 msec 2023-02-08 07:03:27,547 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:03:27,548 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839807547"}]},"ts":"1675839807547"} 2023-02-08 07:03:27,549 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 07:03:27,551 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:03:27,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 384 msec 2023-02-08 07:03:27,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 07:03:27,569 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:27,569 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:27,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:27,572 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44866, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:27,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 07:03:27,579 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:27,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-08 07:03:27,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 07:03:27,590 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:27,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-08 07:03:27,599 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 07:03:27,601 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 07:03:27,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.956sec 2023-02-08 07:03:27,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 07:03:27,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 07:03:27,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 07:03:27,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37997,1675839806533-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 07:03:27,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37997,1675839806533-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 07:03:27,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 07:03:27,637 DEBUG [Listener at localhost/40499] zookeeper.ReadOnlyZKClient(139): Connect 0x28775da3 to 127.0.0.1:63226 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:27,640 DEBUG [Listener at localhost/40499] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32f33b2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:27,641 DEBUG [hconnection-0x13469ddc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:27,643 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47106, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:27,644 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37997,1675839806533 2023-02-08 07:03:27,644 DEBUG [Listener at localhost/40499] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 07:03:27,644 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:27,644 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:27,646 DEBUG [Listener at localhost/40499] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 07:03:27,648 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57818, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 07:03:27,648 INFO [Listener at localhost/40499] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:27,649 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:27,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 07:03:27,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:57818 deadline: 1675839867649, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:27,649 INFO [Listener at localhost/40499] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-08 07:03:27,650 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:27,650 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:27,651 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:27,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:27,653 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:03:27,653 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-08 07:03:27,654 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:27,654 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:27,654 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:03:27,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:27,655 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:27,656 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa empty. 2023-02-08 07:03:27,656 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:27,656 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-08 07:03:27,663 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:27,664 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 948c0e6e4c3c3d59a4282501e2972aaa, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp 2023-02-08 07:03:27,673 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:27,673 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 948c0e6e4c3c3d59a4282501e2972aaa, disabling compactions & flushes 2023-02-08 07:03:27,673 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:27,673 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:27,673 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. after waiting 0 ms 2023-02-08 07:03:27,673 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:27,673 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:27,673 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 948c0e6e4c3c3d59a4282501e2972aaa: Waiting for close lock at 1675839807673Disabling compacts and flushes for region at 1675839807673Disabling writes for close at 1675839807673Writing region close event to WAL at 1675839807673Closed at 1675839807673 2023-02-08 07:03:27,675 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:03:27,676 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675839807676"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839807676"}]},"ts":"1675839807676"} 2023-02-08 07:03:27,677 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 07:03:27,678 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:03:27,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839807678"}]},"ts":"1675839807678"} 2023-02-08 07:03:27,679 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-08 07:03:27,683 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:27,684 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:27,684 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:27,684 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:27,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=948c0e6e4c3c3d59a4282501e2972aaa, ASSIGN}] 2023-02-08 07:03:27,685 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=948c0e6e4c3c3d59a4282501e2972aaa, ASSIGN 2023-02-08 07:03:27,686 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=948c0e6e4c3c3d59a4282501e2972aaa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42571,1675839806620; forceNewPlan=false, retain=false 2023-02-08 07:03:27,755 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:27,755 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:27,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:27,836 INFO [jenkins-hbase4:37997] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 07:03:27,836 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=948c0e6e4c3c3d59a4282501e2972aaa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:27,837 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675839807836"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839807836"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839807836"}]},"ts":"1675839807836"} 2023-02-08 07:03:27,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 948c0e6e4c3c3d59a4282501e2972aaa, server=jenkins-hbase4.apache.org,42571,1675839806620}] 2023-02-08 07:03:27,927 INFO [RS:0;jenkins-hbase4:38691] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38691%2C1675839806595, suffix=, logDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/WALs/jenkins-hbase4.apache.org,38691,1675839806595, archiveDir=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/oldWALs, maxLogs=32 2023-02-08 07:03:27,940 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45729,DS-7c2983d4-f915-4c37-8bba-da5d6bb50043,DISK] 2023-02-08 07:03:27,940 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37915,DS-d71550ef-c4e2-41ef-a5d4-edee3a6bcbf2,DISK] 2023-02-08 07:03:27,942 INFO [RS:0;jenkins-hbase4:38691] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/WALs/jenkins-hbase4.apache.org,38691,1675839806595/jenkins-hbase4.apache.org%2C38691%2C1675839806595.1675839807928 2023-02-08 07:03:27,942 DEBUG [RS:0;jenkins-hbase4:38691] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45729,DS-7c2983d4-f915-4c37-8bba-da5d6bb50043,DISK], DatanodeInfoWithStorage[127.0.0.1:37915,DS-d71550ef-c4e2-41ef-a5d4-edee3a6bcbf2,DISK]] 2023-02-08 07:03:27,956 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:27,956 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:27,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:27,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:27,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 948c0e6e4c3c3d59a4282501e2972aaa, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:27,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:27,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:27,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:27,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:27,994 INFO [StoreOpener-948c0e6e4c3c3d59a4282501e2972aaa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:27,995 DEBUG [StoreOpener-948c0e6e4c3c3d59a4282501e2972aaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1 2023-02-08 07:03:27,995 DEBUG [StoreOpener-948c0e6e4c3c3d59a4282501e2972aaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1 2023-02-08 07:03:27,995 INFO [StoreOpener-948c0e6e4c3c3d59a4282501e2972aaa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 948c0e6e4c3c3d59a4282501e2972aaa columnFamilyName f1 2023-02-08 07:03:27,996 INFO [StoreOpener-948c0e6e4c3c3d59a4282501e2972aaa-1] regionserver.HStore(310): Store=948c0e6e4c3c3d59a4282501e2972aaa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:27,996 INFO [StoreOpener-948c0e6e4c3c3d59a4282501e2972aaa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:27,997 DEBUG [StoreOpener-948c0e6e4c3c3d59a4282501e2972aaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2 2023-02-08 07:03:27,997 DEBUG [StoreOpener-948c0e6e4c3c3d59a4282501e2972aaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2 2023-02-08 07:03:27,997 INFO [StoreOpener-948c0e6e4c3c3d59a4282501e2972aaa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 948c0e6e4c3c3d59a4282501e2972aaa columnFamilyName f2 2023-02-08 07:03:27,997 INFO [StoreOpener-948c0e6e4c3c3d59a4282501e2972aaa-1] regionserver.HStore(310): Store=948c0e6e4c3c3d59a4282501e2972aaa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:27,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:27,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:28,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:28,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:28,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:28,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 948c0e6e4c3c3d59a4282501e2972aaa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59239003, jitterRate=-0.11727006733417511}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:28,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 948c0e6e4c3c3d59a4282501e2972aaa: Running coprocessor pre-open hook at 1675839807993Writing region info on filesystem at 1675839807993Initializing all the Stores at 1675839807993Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839807993Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839807994 (+1 ms)Cleaning up temporary data from old regions at 1675839807999 (+5 ms)Cleaning up detritus from prior splits at 1675839807999Running coprocessor post-open hooks at 1675839808002 (+3 ms)Region opened successfully at 1675839808002 2023-02-08 07:03:28,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa., pid=12, masterSystemTime=1675839807990 2023-02-08 07:03:28,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:28,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:28,005 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=948c0e6e4c3c3d59a4282501e2972aaa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,005 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675839808005"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839808005"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839808005"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839808005"}]},"ts":"1675839808005"} 2023-02-08 07:03:28,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-08 07:03:28,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 948c0e6e4c3c3d59a4282501e2972aaa, server=jenkins-hbase4.apache.org,42571,1675839806620 in 168 msec 2023-02-08 07:03:28,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-08 07:03:28,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=948c0e6e4c3c3d59a4282501e2972aaa, ASSIGN in 323 msec 2023-02-08 07:03:28,009 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:03:28,009 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839808009"}]},"ts":"1675839808009"} 2023-02-08 07:03:28,010 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-08 07:03:28,012 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:03:28,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 360 msec 2023-02-08 07:03:28,257 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:28,258 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:28,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:28,259 INFO [Listener at localhost/40499] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-08 07:03:28,259 DEBUG [Listener at localhost/40499] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-08 07:03:28,259 INFO [Listener at localhost/40499] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:03:28,261 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-08 07:03:28,261 INFO [Listener at localhost/40499] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:03:28,261 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-08 07:03:28,261 INFO [Listener at localhost/40499] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 07:03:28,273 DEBUG [hconnection-0x13469ddc-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:28,284 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44874, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:28,291 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42571] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:28,425 INFO [Listener at localhost/40499] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 07:03:28,425 INFO [Listener at localhost/40499] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 07:03:28,425 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:28,425 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:28,426 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-08 07:03:28,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675839808426 (current time:1675839808426). 2023-02-08 07:03:28,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 07:03:28,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] zookeeper.ReadOnlyZKClient(139): Connect 0x101e70f8 to 127.0.0.1:63226 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:28,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4abe4193, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:28,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:28,432 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47120, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:28,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x101e70f8 to 127.0.0.1:63226 2023-02-08 07:03:28,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:28,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 07:03:28,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-08 07:03:28,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-08 07:03:28,436 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-08 07:03:28,437 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1675840408437 2023-02-08 07:03:28,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-08 07:03:28,437 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,438 DEBUG [Listener at localhost/40499] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 07:03:28,439 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-08 07:03:28,439 DEBUG [Listener at localhost/40499] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 07:03:28,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-08 07:03:28,440 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 4 msec 2023-02-08 07:03:28,441 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-08 07:03:28,441 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1675840408441 2023-02-08 07:03:28,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-08 07:03:28,455 INFO [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-08 07:03:28,455 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:28,456 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-08 07:03:28,456 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-08 07:03:28,456 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,456 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-08 07:03:28,457 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:28,457 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:28,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:28,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:28,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:28,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:28,457 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-08 07:03:28,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-08 07:03:28,458 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,458 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:03:28,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-08 07:03:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-08 07:03:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-08 07:03:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-08 07:03:28,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-08 07:03:28,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-08 07:03:28,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-08 07:03:28,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-08 07:03:28,459 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-08 07:03:28,459 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-08 07:03:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-08 07:03:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38691,1675839806595' joining acquired barrier for procedure (foo) in zk 2023-02-08 07:03:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-08 07:03:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-08 07:03:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-08 07:03:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42571,1675839806620' joining acquired barrier for procedure (foo) in zk 2023-02-08 07:03:28,462 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,463 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:28,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:28,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 07:03:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:28,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42571,1675839806620' joining acquired barrier for procedure 'foo' on coordinator 2023-02-08 07:03:28,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e638b03[Count = 0] remaining members to acquire global barrier 2023-02-08 07:03:28,465 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-08 07:03:28,465 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,467 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,467 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,467 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,467 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-08 07:03:28,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,467 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-08 07:03:28,467 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-08 07:03:28,467 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:03:28,467 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,38691,1675839806595' in zk 2023-02-08 07:03:28,467 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-08 07:03:28,467 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 07:03:28,467 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:28,468 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. started... 2023-02-08 07:03:28,468 INFO [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 948c0e6e4c3c3d59a4282501e2972aaa 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-08 07:03:28,469 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-08 07:03:28,469 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:28,469 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-08 07:03:28,480 INFO [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/.tmp/f1/2b72c2b6f4f647308f46d4ab4f2d5090 2023-02-08 07:03:28,502 INFO [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/.tmp/f2/b06abe5b8bdc484aaed4dc6795a65190 2023-02-08 07:03:28,506 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/.tmp/f1/2b72c2b6f4f647308f46d4ab4f2d5090 as hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1/2b72c2b6f4f647308f46d4ab4f2d5090 2023-02-08 07:03:28,509 INFO [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1/2b72c2b6f4f647308f46d4ab4f2d5090, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 07:03:28,510 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/.tmp/f2/b06abe5b8bdc484aaed4dc6795a65190 as hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2/b06abe5b8bdc484aaed4dc6795a65190 2023-02-08 07:03:28,514 INFO [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2/b06abe5b8bdc484aaed4dc6795a65190, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 07:03:28,514 INFO [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 948c0e6e4c3c3d59a4282501e2972aaa in 46ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:28,514 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-08 07:03:28,515 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 948c0e6e4c3c3d59a4282501e2972aaa: 2023-02-08 07:03:28,515 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.' region-info for snapshot=foo 2023-02-08 07:03:28,515 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:28,515 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1/2b72c2b6f4f647308f46d4ab4f2d5090] hfiles 2023-02-08 07:03:28,515 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1/2b72c2b6f4f647308f46d4ab4f2d5090 for snapshot=foo 2023-02-08 07:03:28,515 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2/b06abe5b8bdc484aaed4dc6795a65190] hfiles 2023-02-08 07:03:28,515 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2/b06abe5b8bdc484aaed4dc6795a65190 for snapshot=foo 2023-02-08 07:03:28,520 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. completed. 2023-02-08 07:03:28,520 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:28,520 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-08 07:03:28,520 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-08 07:03:28,520 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,520 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-08 07:03:28,520 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,42571,1675839806620' in zk 2023-02-08 07:03:28,522 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,522 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-08 07:03:28,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:28,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:28,522 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:28,522 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-08 07:03:28,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:28,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:28,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 07:03:28,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:28,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 07:03:28,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,42571,1675839806620': 2023-02-08 07:03:28,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42571,1675839806620' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-08 07:03:28,525 INFO [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-08 07:03:28,525 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:03:28,525 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:03:28,525 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-08 07:03:28,525 INFO [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 07:03:28,526 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,526 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,526 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,526 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:28,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:28,526 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:28,527 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:28,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:28,527 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 07:03:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 07:03:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,528 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,529 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:28,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 07:03:28,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,537 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,537 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:28,537 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:28,537 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-08 07:03:28,537 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:28,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/foo because node does not exist (not an error) 2023-02-08 07:03:28,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-08 07:03:28,538 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-08 07:03:28,538 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-08 07:03:28,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:28,537 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:28,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:28,537 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:28,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:28,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:28,538 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,538 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,538 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,538 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 07:03:28,538 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 07:03:28,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.hbase-snapshot/.tmp/foo 2023-02-08 07:03:28,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:28,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:28,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:28,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:28,539 DEBUG [Listener at localhost/40499] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:28,540 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:28,540 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:28,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-08 07:03:28,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:03:28,541 DEBUG [Listener at localhost/40499] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 07:03:28,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.hbase-snapshot/.tmp/foo to hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.hbase-snapshot/foo 2023-02-08 07:03:28,578 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-08 07:03:28,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.hbase-snapshot/.tmp/foo 2023-02-08 07:03:28,578 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.hbase-snapshot/.tmp/foo 2023-02-08 07:03:28,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1675839808437Consolidate snapshot: foo at 1675839808538 (+101 ms)Loading Region manifests for foo at 1675839808538Writing data manifest for foo at 1675839808540 (+2 ms)Verifying snapshot: foo at 1675839808550 (+10 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1675839808578 (+28 ms) 2023-02-08 07:03:28,580 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-08 07:03:28,581 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 142 msec 2023-02-08 07:03:28,741 DEBUG [Listener at localhost/40499] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:28,741 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:28,741 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:28,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-08 07:03:28,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 07:03:28,743 INFO [Listener at localhost/40499] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 07:03:28,743 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:28,743 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:28,747 INFO [Listener at localhost/40499] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 07:03:28,751 INFO [Listener at localhost/40499] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 07:03:28,782 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42571] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:28,862 INFO [Listener at localhost/40499] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 07:03:28,865 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:28,865 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:28,867 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 07:03:28,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,869 INFO [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-08 07:03:28,869 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:28,870 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-08 07:03:28,870 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-08 07:03:28,870 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,870 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,872 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:28,872 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:28,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:28,872 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:28,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:28,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:28,872 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,872 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:03:28,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:03:28,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,873 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:03:28,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,873 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,874 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-08 07:03:28,874 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:28,874 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-08 07:03:28,874 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:28,874 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-08 07:03:28,875 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-08 07:03:28,875 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-08 07:03:28,875 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38691,1675839806595' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-08 07:03:28,875 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 07:03:28,875 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 07:03:28,875 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:28,875 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. started... 2023-02-08 07:03:28,876 INFO [rs(jenkins-hbase4.apache.org,42571,1675839806620)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 948c0e6e4c3c3d59a4282501e2972aaa 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-08 07:03:28,877 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,877 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,877 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:28,895 INFO [rs(jenkins-hbase4.apache.org,42571,1675839806620)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/.tmp/f1/fe6f81a87972426fb330218e488d1c7f 2023-02-08 07:03:28,920 INFO [rs(jenkins-hbase4.apache.org,42571,1675839806620)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/.tmp/f2/57154c0be8c84c15a1e744409c386d1c 2023-02-08 07:03:28,924 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/.tmp/f1/fe6f81a87972426fb330218e488d1c7f as hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1/fe6f81a87972426fb330218e488d1c7f 2023-02-08 07:03:28,928 INFO [rs(jenkins-hbase4.apache.org,42571,1675839806620)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1/fe6f81a87972426fb330218e488d1c7f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 07:03:28,929 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/.tmp/f2/57154c0be8c84c15a1e744409c386d1c as hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2/57154c0be8c84c15a1e744409c386d1c 2023-02-08 07:03:28,933 INFO [rs(jenkins-hbase4.apache.org,42571,1675839806620)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2/57154c0be8c84c15a1e744409c386d1c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 07:03:28,934 INFO [rs(jenkins-hbase4.apache.org,42571,1675839806620)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 948c0e6e4c3c3d59a4282501e2972aaa in 59ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:28,935 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 948c0e6e4c3c3d59a4282501e2972aaa: 2023-02-08 07:03:28,935 DEBUG [rs(jenkins-hbase4.apache.org,42571,1675839806620)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 07:03:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 07:03:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-08 07:03:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42571,1675839806620' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-08 07:03:28,937 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,937 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:28,937 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,937 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:28,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42571,1675839806620' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-08 07:03:28,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a5c0e17[Count = 0] remaining members to acquire global barrier 2023-02-08 07:03:28,939 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-08 07:03:28,939 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,941 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,941 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,942 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-08 07:03:28,942 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-08 07:03:28,942 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-08 07:03:28,942 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-08 07:03:28,942 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,38691,1675839806595' in zk 2023-02-08 07:03:28,942 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,942 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:03:28,942 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,42571,1675839806620' in zk 2023-02-08 07:03:28,943 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-08 07:03:28,943 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:28,943 DEBUG [member: 'jenkins-hbase4.apache.org,38691,1675839806595' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-08 07:03:28,944 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,42571,1675839806620': 2023-02-08 07:03:28,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42571,1675839806620' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-08 07:03:28,947 INFO [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-08 07:03:28,947 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:03:28,947 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:03:28,947 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,947 INFO [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 07:03:28,947 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-08 07:03:28,947 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:28,947 DEBUG [member: 'jenkins-hbase4.apache.org,42571,1675839806620' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-08 07:03:28,949 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,949 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,949 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,949 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,949 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:28,949 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:28,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:28,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:28,950 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:28,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:28,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:28,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,952 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,952 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:28,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,956 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:28,956 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:28,956 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:28,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:28,957 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:28,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:28,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:28,957 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,957 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-08 07:03:28,957 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 07:03:28,957 DEBUG [(jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:28,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:28,957 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,957 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,957 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,957 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:28,957 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,957 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:28,957 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,957 DEBUG [Listener at localhost/40499] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-08 07:03:28,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:28,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:28,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:28,957 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:28,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:28,957 DEBUG [Listener at localhost/40499] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 07:03:29,058 DEBUG [Listener at localhost/40499] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 07:03:29,058 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:29,058 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:29,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 07:03:29,064 INFO [Listener at localhost/40499] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675839808426 type: FLUSH version: 2 ttl: 0 2023-02-08 07:03:29,064 DEBUG [Listener at localhost/40499] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42793/user/jenkins/test-data/ad3f8bfa-4267-02e3-5e8f-eaf69f7f4151/foo/b5290a91-da71-4786-9910-c83af930dfbb/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,064 INFO [Listener at localhost/40499] snapshot.RestoreSnapshotHelper(239): region to add: 948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:29,064 INFO [Listener at localhost/40499] snapshot.RestoreSnapshotHelper(585): clone region=948c0e6e4c3c3d59a4282501e2972aaa as 948c0e6e4c3c3d59a4282501e2972aaa in snapshot foo 2023-02-08 07:03:29,065 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 948c0e6e4c3c3d59a4282501e2972aaa, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42793/user/jenkins/test-data/ad3f8bfa-4267-02e3-5e8f-eaf69f7f4151/foo/b5290a91-da71-4786-9910-c83af930dfbb 2023-02-08 07:03:29,070 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:29,071 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2b72c2b6f4f647308f46d4ab4f2d5090 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,072 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b06abe5b8bdc484aaed4dc6795a65190 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,074 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 948c0e6e4c3c3d59a4282501e2972aaa, disabling compactions & flushes 2023-02-08 07:03:29,074 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:29,074 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:29,074 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. after waiting 0 ms 2023-02-08 07:03:29,074 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:29,074 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:29,074 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 948c0e6e4c3c3d59a4282501e2972aaa: Waiting for close lock at 1675839809074Disabling compacts and flushes for region at 1675839809074Disabling writes for close at 1675839809074Writing region close event to WAL at 1675839809074Closed at 1675839809074 2023-02-08 07:03:29,076 INFO [Listener at localhost/40499] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675839808426 type: FLUSH version: 2 ttl: 0 2023-02-08 07:03:29,076 DEBUG [Listener at localhost/40499] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:42793/user/jenkins/test-data/ad3f8bfa-4267-02e3-5e8f-eaf69f7f4151/foo/b5290a91-da71-4786-9910-c83af930dfbb 2023-02-08 07:03:29,076 DEBUG [Listener at localhost/40499] util.CommonFSUtils(682): File system contents for path hdfs://localhost:42793/user/jenkins/test-data/ad3f8bfa-4267-02e3-5e8f-eaf69f7f4151/foo/b5290a91-da71-4786-9910-c83af930dfbb 2023-02-08 07:03:29,076 DEBUG [Listener at localhost/40499] util.CommonFSUtils(699): |-data/ 2023-02-08 07:03:29,077 DEBUG [Listener at localhost/40499] util.CommonFSUtils(699): |----default/ 2023-02-08 07:03:29,077 DEBUG [Listener at localhost/40499] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-08 07:03:29,077 DEBUG [Listener at localhost/40499] util.CommonFSUtils(699): |----------948c0e6e4c3c3d59a4282501e2972aaa/ 2023-02-08 07:03:29,078 DEBUG [Listener at localhost/40499] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:29,078 DEBUG [Listener at localhost/40499] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:29,078 DEBUG [Listener at localhost/40499] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=948c0e6e4c3c3d59a4282501e2972aaa-2b72c2b6f4f647308f46d4ab4f2d5090 2023-02-08 07:03:29,078 DEBUG [Listener at localhost/40499] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:29,078 DEBUG [Listener at localhost/40499] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=948c0e6e4c3c3d59a4282501e2972aaa-b06abe5b8bdc484aaed4dc6795a65190 hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1/2b72c2b6f4f647308f46d4ab4f2d5090 hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1/fe6f81a87972426fb330218e488d1c7f hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2/57154c0be8c84c15a1e744409c386d1c hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2/b06abe5b8bdc484aaed4dc6795a65190 2023-02-08 07:03:29,083 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:29,083 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:29,084 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-08 07:03:29,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-08 07:03:29,086 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:29,086 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:29,086 INFO [Listener at localhost/40499] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,086 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,089 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:29,089 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:29,090 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839809089"}]},"ts":"1675839809089"} 2023-02-08 07:03:29,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 07:03:29,090 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-08 07:03:29,093 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-08 07:03:29,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=948c0e6e4c3c3d59a4282501e2972aaa, UNASSIGN}] 2023-02-08 07:03:29,095 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=948c0e6e4c3c3d59a4282501e2972aaa, UNASSIGN 2023-02-08 07:03:29,095 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=948c0e6e4c3c3d59a4282501e2972aaa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:29,095 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675839809095"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839809095"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839809095"}]},"ts":"1675839809095"} 2023-02-08 07:03:29,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 948c0e6e4c3c3d59a4282501e2972aaa, server=jenkins-hbase4.apache.org,42571,1675839806620}] 2023-02-08 07:03:29,190 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:29,190 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:29,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 07:03:29,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:29,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 948c0e6e4c3c3d59a4282501e2972aaa, disabling compactions & flushes 2023-02-08 07:03:29,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:29,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:29,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. after waiting 0 ms 2023-02-08 07:03:29,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:29,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:29,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa. 2023-02-08 07:03:29,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 948c0e6e4c3c3d59a4282501e2972aaa: Waiting for close lock at 1675839809248Running coprocessor pre-close hooks at 1675839809248Disabling compacts and flushes for region at 1675839809248Disabling writes for close at 1675839809248Writing region close event to WAL at 1675839809249 (+1 ms)Running coprocessor post-close hooks at 1675839809252 (+3 ms)Closed at 1675839809252 2023-02-08 07:03:29,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:29,254 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=948c0e6e4c3c3d59a4282501e2972aaa, regionState=CLOSED 2023-02-08 07:03:29,254 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675839809254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839809254"}]},"ts":"1675839809254"} 2023-02-08 07:03:29,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-08 07:03:29,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 948c0e6e4c3c3d59a4282501e2972aaa, server=jenkins-hbase4.apache.org,42571,1675839806620 in 159 msec 2023-02-08 07:03:29,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-08 07:03:29,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=948c0e6e4c3c3d59a4282501e2972aaa, UNASSIGN in 163 msec 2023-02-08 07:03:29,258 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839809258"}]},"ts":"1675839809258"} 2023-02-08 07:03:29,259 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-08 07:03:29,261 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-08 07:03:29,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 175 msec 2023-02-08 07:03:29,391 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:29,392 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:29,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 07:03:29,393 INFO [Listener at localhost/40499] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-08 07:03:29,393 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:29,393 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:29,393 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,396 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,396 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:29,396 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:29,396 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 07:03:29,399 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:29,401 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1, FileablePath, hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2, FileablePath, hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/recovered.edits] 2023-02-08 07:03:29,404 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1/2b72c2b6f4f647308f46d4ab4f2d5090 to hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1/2b72c2b6f4f647308f46d4ab4f2d5090 2023-02-08 07:03:29,405 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1/fe6f81a87972426fb330218e488d1c7f to hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f1/fe6f81a87972426fb330218e488d1c7f 2023-02-08 07:03:29,407 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2/57154c0be8c84c15a1e744409c386d1c to hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2/57154c0be8c84c15a1e744409c386d1c 2023-02-08 07:03:29,408 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2/b06abe5b8bdc484aaed4dc6795a65190 to hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/f2/b06abe5b8bdc484aaed4dc6795a65190 2023-02-08 07:03:29,410 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/recovered.edits/12.seqid to hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa/recovered.edits/12.seqid 2023-02-08 07:03:29,410 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/948c0e6e4c3c3d59a4282501e2972aaa 2023-02-08 07:03:29,410 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-08 07:03:29,412 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,413 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-08 07:03:29,415 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-08 07:03:29,418 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,418 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-08 07:03:29,418 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839809418"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:29,419 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-08 07:03:29,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 948c0e6e4c3c3d59a4282501e2972aaa, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675839807651.948c0e6e4c3c3d59a4282501e2972aaa.', STARTKEY => '', ENDKEY => ''}] 2023-02-08 07:03:29,420 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-08 07:03:29,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675839809420"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:29,421 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-08 07:03:29,422 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 07:03:29,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 29 msec 2023-02-08 07:03:29,497 INFO [Listener at localhost/40499] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:29,497 INFO [Listener at localhost/40499] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:29,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 07:03:29,498 INFO [Listener at localhost/40499] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-08 07:03:29,498 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 07:03:29,498 INFO [Listener at localhost/40499] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 07:03:29,499 DEBUG [Listener at localhost/40499] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28775da3 to 127.0.0.1:63226 2023-02-08 07:03:29,499 DEBUG [Listener at localhost/40499] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:29,499 DEBUG [Listener at localhost/40499] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 07:03:29,499 DEBUG [Listener at localhost/40499] util.JVMClusterUtil(257): Found active master hash=879678071, stopped=false 2023-02-08 07:03:29,499 INFO [Listener at localhost/40499] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37997,1675839806533 2023-02-08 07:03:29,503 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:29,503 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:29,503 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:29,503 INFO [Listener at localhost/40499] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 07:03:29,503 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:29,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:29,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:29,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:29,505 DEBUG [Listener at localhost/40499] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06aaf922 to 127.0.0.1:63226 2023-02-08 07:03:29,505 DEBUG [Listener at localhost/40499] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:29,505 INFO [Listener at localhost/40499] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38691,1675839806595' ***** 2023-02-08 07:03:29,505 INFO [Listener at localhost/40499] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:03:29,505 INFO [Listener at localhost/40499] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42571,1675839806620' ***** 2023-02-08 07:03:29,505 INFO [Listener at localhost/40499] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:03:29,505 INFO [RS:1;jenkins-hbase4:42571] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:03:29,505 INFO [RS:1;jenkins-hbase4:42571] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:03:29,505 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:03:29,505 INFO [RS:0;jenkins-hbase4:38691] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:03:29,505 INFO [RS:1;jenkins-hbase4:42571] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:03:29,506 INFO [RS:0;jenkins-hbase4:38691] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:03:29,506 INFO [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(3304): Received CLOSE for 18ea901fabfdd3caef7c9b4eb069fc9e 2023-02-08 07:03:29,506 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:03:29,507 INFO [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:29,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 18ea901fabfdd3caef7c9b4eb069fc9e, disabling compactions & flushes 2023-02-08 07:03:29,506 INFO [RS:0;jenkins-hbase4:38691] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:03:29,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. 2023-02-08 07:03:29,507 INFO [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:29,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. 2023-02-08 07:03:29,507 DEBUG [RS:0;jenkins-hbase4:38691] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a83a7c1 to 127.0.0.1:63226 2023-02-08 07:03:29,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. after waiting 0 ms 2023-02-08 07:03:29,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. 2023-02-08 07:03:29,507 DEBUG [RS:0;jenkins-hbase4:38691] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:29,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 18ea901fabfdd3caef7c9b4eb069fc9e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 07:03:29,507 DEBUG [RS:1;jenkins-hbase4:42571] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02595cdf to 127.0.0.1:63226 2023-02-08 07:03:29,508 INFO [RS:0;jenkins-hbase4:38691] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:03:29,508 DEBUG [RS:1;jenkins-hbase4:42571] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:29,508 INFO [RS:0;jenkins-hbase4:38691] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:03:29,508 INFO [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 07:03:29,508 INFO [RS:0;jenkins-hbase4:38691] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:03:29,508 DEBUG [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(1479): Online Regions={18ea901fabfdd3caef7c9b4eb069fc9e=hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e.} 2023-02-08 07:03:29,508 INFO [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 07:03:29,508 DEBUG [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(1505): Waiting on 18ea901fabfdd3caef7c9b4eb069fc9e 2023-02-08 07:03:29,508 INFO [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 07:03:29,508 DEBUG [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-08 07:03:29,508 DEBUG [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 07:03:29,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:03:29,508 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:03:29,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:03:29,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:03:29,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:03:29,508 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-08 07:03:29,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e/.tmp/info/5f15e1956f7d49b7897050e6fe66e1aa 2023-02-08 07:03:29,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/.tmp/info/79a621d12c5549949ce1ae1ab11485d5 2023-02-08 07:03:29,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e/.tmp/info/5f15e1956f7d49b7897050e6fe66e1aa as hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e/info/5f15e1956f7d49b7897050e6fe66e1aa 2023-02-08 07:03:29,519 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79a621d12c5549949ce1ae1ab11485d5 2023-02-08 07:03:29,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e/info/5f15e1956f7d49b7897050e6fe66e1aa, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 07:03:29,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 18ea901fabfdd3caef7c9b4eb069fc9e in 15ms, sequenceid=6, compaction requested=false 2023-02-08 07:03:29,526 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/.tmp/rep_barrier/f0d835742abf4407b8a1171c22a0c6dc 2023-02-08 07:03:29,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/namespace/18ea901fabfdd3caef7c9b4eb069fc9e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 07:03:29,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. 2023-02-08 07:03:29,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 18ea901fabfdd3caef7c9b4eb069fc9e: Waiting for close lock at 1675839809507Running coprocessor pre-close hooks at 1675839809507Disabling compacts and flushes for region at 1675839809507Disabling writes for close at 1675839809508 (+1 ms)Obtaining lock to block concurrent updates at 1675839809508Preparing flush snapshotting stores in 18ea901fabfdd3caef7c9b4eb069fc9e at 1675839809508Finished memstore snapshotting hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675839809508Flushing stores of hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. at 1675839809508Flushing 18ea901fabfdd3caef7c9b4eb069fc9e/info: creating writer at 1675839809508Flushing 18ea901fabfdd3caef7c9b4eb069fc9e/info: appending metadata at 1675839809510 (+2 ms)Flushing 18ea901fabfdd3caef7c9b4eb069fc9e/info: closing flushed file at 1675839809510Flushing 18ea901fabfdd3caef7c9b4eb069fc9e/info: reopening flushed file at 1675839809520 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 18ea901fabfdd3caef7c9b4eb069fc9e in 15ms, sequenceid=6, compaction requested=false at 1675839809523 (+3 ms)Writing region close event to WAL at 1675839809524 (+1 ms)Running coprocessor post-close hooks at 1675839809527 (+3 ms)Closed at 1675839809527 2023-02-08 07:03:29,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675839807167.18ea901fabfdd3caef7c9b4eb069fc9e. 2023-02-08 07:03:29,529 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0d835742abf4407b8a1171c22a0c6dc 2023-02-08 07:03:29,535 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/.tmp/table/7e8b2f3ab9c84189841daac936995a17 2023-02-08 07:03:29,538 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e8b2f3ab9c84189841daac936995a17 2023-02-08 07:03:29,539 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/.tmp/info/79a621d12c5549949ce1ae1ab11485d5 as hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/info/79a621d12c5549949ce1ae1ab11485d5 2023-02-08 07:03:29,542 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79a621d12c5549949ce1ae1ab11485d5 2023-02-08 07:03:29,542 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/info/79a621d12c5549949ce1ae1ab11485d5, entries=12, sequenceid=21, filesize=6.3 K 2023-02-08 07:03:29,543 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/.tmp/rep_barrier/f0d835742abf4407b8a1171c22a0c6dc as hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/rep_barrier/f0d835742abf4407b8a1171c22a0c6dc 2023-02-08 07:03:29,546 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0d835742abf4407b8a1171c22a0c6dc 2023-02-08 07:03:29,546 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/rep_barrier/f0d835742abf4407b8a1171c22a0c6dc, entries=1, sequenceid=21, filesize=5.1 K 2023-02-08 07:03:29,546 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/.tmp/table/7e8b2f3ab9c84189841daac936995a17 as hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/table/7e8b2f3ab9c84189841daac936995a17 2023-02-08 07:03:29,550 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e8b2f3ab9c84189841daac936995a17 2023-02-08 07:03:29,550 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/table/7e8b2f3ab9c84189841daac936995a17, entries=4, sequenceid=21, filesize=5.1 K 2023-02-08 07:03:29,551 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 43ms, sequenceid=21, compaction requested=false 2023-02-08 07:03:29,554 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-08 07:03:29,554 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 07:03:29,554 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:29,554 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839809508Running coprocessor pre-close hooks at 1675839809508Disabling compacts and flushes for region at 1675839809508Disabling writes for close at 1675839809508Obtaining lock to block concurrent updates at 1675839809508Preparing flush snapshotting stores in 1588230740 at 1675839809508Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1675839809509 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675839809509Flushing 1588230740/info: creating writer at 1675839809509Flushing 1588230740/info: appending metadata at 1675839809511 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675839809511Flushing 1588230740/rep_barrier: creating writer at 1675839809519 (+8 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675839809521 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675839809521Flushing 1588230740/table: creating writer at 1675839809529 (+8 ms)Flushing 1588230740/table: appending metadata at 1675839809531 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675839809531Flushing 1588230740/info: reopening flushed file at 1675839809539 (+8 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675839809543 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675839809547 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 43ms, sequenceid=21, compaction requested=false at 1675839809551 (+4 ms)Writing region close event to WAL at 1675839809551Running coprocessor post-close hooks at 1675839809554 (+3 ms)Closed at 1675839809554 2023-02-08 07:03:29,554 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:29,588 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:29,595 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:29,708 INFO [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42571,1675839806620; all regions closed. 2023-02-08 07:03:29,708 INFO [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38691,1675839806595; all regions closed. 2023-02-08 07:03:29,713 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/WALs/jenkins-hbase4.apache.org,42571,1675839806620/jenkins-hbase4.apache.org%2C42571%2C1675839806620.1675839807514 not finished, retry = 0 2023-02-08 07:03:29,715 DEBUG [RS:0;jenkins-hbase4:38691] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/oldWALs 2023-02-08 07:03:29,715 INFO [RS:0;jenkins-hbase4:38691] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38691%2C1675839806595.meta:.meta(num 1675839807118) 2023-02-08 07:03:29,720 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/WALs/jenkins-hbase4.apache.org,38691,1675839806595/jenkins-hbase4.apache.org%2C38691%2C1675839806595.1675839807928 not finished, retry = 0 2023-02-08 07:03:29,815 DEBUG [RS:1;jenkins-hbase4:42571] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/oldWALs 2023-02-08 07:03:29,816 INFO [RS:1;jenkins-hbase4:42571] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42571%2C1675839806620:(num 1675839807514) 2023-02-08 07:03:29,816 DEBUG [RS:1;jenkins-hbase4:42571] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:29,816 INFO [RS:1;jenkins-hbase4:42571] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:29,816 INFO [RS:1;jenkins-hbase4:42571] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 07:03:29,816 INFO [RS:1;jenkins-hbase4:42571] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:03:29,816 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:29,816 INFO [RS:1;jenkins-hbase4:42571] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:03:29,816 INFO [RS:1;jenkins-hbase4:42571] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:03:29,817 INFO [RS:1;jenkins-hbase4:42571] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42571 2023-02-08 07:03:29,819 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:29,819 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42571,1675839806620 2023-02-08 07:03:29,819 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:29,819 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:29,819 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:29,819 ERROR [Listener at localhost/40499-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7cddfd42 rejected from java.util.concurrent.ThreadPoolExecutor@78e27601[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:29,820 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42571,1675839806620] 2023-02-08 07:03:29,820 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42571,1675839806620; numProcessing=1 2023-02-08 07:03:29,821 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42571,1675839806620 already deleted, retry=false 2023-02-08 07:03:29,821 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42571,1675839806620 expired; onlineServers=1 2023-02-08 07:03:29,822 DEBUG [RS:0;jenkins-hbase4:38691] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/oldWALs 2023-02-08 07:03:29,822 INFO [RS:0;jenkins-hbase4:38691] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38691%2C1675839806595:(num 1675839807928) 2023-02-08 07:03:29,822 DEBUG [RS:0;jenkins-hbase4:38691] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:29,822 INFO [RS:0;jenkins-hbase4:38691] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:29,822 INFO [RS:0;jenkins-hbase4:38691] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 07:03:29,822 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:29,823 INFO [RS:0;jenkins-hbase4:38691] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38691 2023-02-08 07:03:29,826 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38691,1675839806595 2023-02-08 07:03:29,826 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:29,826 ERROR [Listener at localhost/40499-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3d676c37 rejected from java.util.concurrent.ThreadPoolExecutor@3958ef43[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:29,827 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38691,1675839806595] 2023-02-08 07:03:29,827 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38691,1675839806595; numProcessing=2 2023-02-08 07:03:29,828 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38691,1675839806595 already deleted, retry=false 2023-02-08 07:03:29,828 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38691,1675839806595 expired; onlineServers=0 2023-02-08 07:03:29,828 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37997,1675839806533' ***** 2023-02-08 07:03:29,828 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 07:03:29,829 DEBUG [M:0;jenkins-hbase4:37997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30514022, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:29,829 INFO [M:0;jenkins-hbase4:37997] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37997,1675839806533 2023-02-08 07:03:29,829 INFO [M:0;jenkins-hbase4:37997] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37997,1675839806533; all regions closed. 2023-02-08 07:03:29,829 DEBUG [M:0;jenkins-hbase4:37997] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:29,829 DEBUG [M:0;jenkins-hbase4:37997] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 07:03:29,829 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 07:03:29,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839806769] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839806769,5,FailOnTimeoutGroup] 2023-02-08 07:03:29,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839806769] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839806769,5,FailOnTimeoutGroup] 2023-02-08 07:03:29,829 DEBUG [M:0;jenkins-hbase4:37997] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 07:03:29,830 INFO [M:0;jenkins-hbase4:37997] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 07:03:29,830 INFO [M:0;jenkins-hbase4:37997] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 07:03:29,830 INFO [M:0;jenkins-hbase4:37997] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 07:03:29,831 DEBUG [M:0;jenkins-hbase4:37997] master.HMaster(1502): Stopping service threads 2023-02-08 07:03:29,831 INFO [M:0;jenkins-hbase4:37997] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 07:03:29,831 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:29,831 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:29,831 ERROR [M:0;jenkins-hbase4:37997] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-08 07:03:29,832 INFO [M:0;jenkins-hbase4:37997] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 07:03:29,832 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 07:03:29,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:29,832 DEBUG [M:0;jenkins-hbase4:37997] zookeeper.ZKUtil(398): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 07:03:29,832 WARN [M:0;jenkins-hbase4:37997] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 07:03:29,832 INFO [M:0;jenkins-hbase4:37997] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 07:03:29,833 INFO [M:0;jenkins-hbase4:37997] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 07:03:29,833 DEBUG [M:0;jenkins-hbase4:37997] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:03:29,833 INFO [M:0;jenkins-hbase4:37997] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:29,833 DEBUG [M:0;jenkins-hbase4:37997] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:29,833 DEBUG [M:0;jenkins-hbase4:37997] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:03:29,833 DEBUG [M:0;jenkins-hbase4:37997] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:29,833 INFO [M:0;jenkins-hbase4:37997] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.68 KB heapSize=67.66 KB 2023-02-08 07:03:29,841 INFO [M:0;jenkins-hbase4:37997] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.68 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/defb9ec1d07a438fbed215e376d662eb 2023-02-08 07:03:29,845 DEBUG [M:0;jenkins-hbase4:37997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/defb9ec1d07a438fbed215e376d662eb as hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/defb9ec1d07a438fbed215e376d662eb 2023-02-08 07:03:29,848 INFO [M:0;jenkins-hbase4:37997] regionserver.HStore(1080): Added hdfs://localhost:42793/user/jenkins/test-data/57c4617e-c506-496b-bbf5-cb65bd34f0a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/defb9ec1d07a438fbed215e376d662eb, entries=17, sequenceid=132, filesize=8.7 K 2023-02-08 07:03:29,849 INFO [M:0;jenkins-hbase4:37997] regionserver.HRegion(2947): Finished flush of dataSize ~56.68 KB/58040, heapSize ~67.64 KB/69264, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-08 07:03:29,850 INFO [M:0;jenkins-hbase4:37997] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:29,850 DEBUG [M:0;jenkins-hbase4:37997] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839809833Disabling compacts and flushes for region at 1675839809833Disabling writes for close at 1675839809833Obtaining lock to block concurrent updates at 1675839809833Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675839809833Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58040, getHeapSize=69264, getOffHeapSize=0, getCellsCount=145 at 1675839809833Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675839809834 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675839809834Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675839809836 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675839809836Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675839809845 (+9 ms)Finished flush of dataSize ~56.68 KB/58040, heapSize ~67.64 KB/69264, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1675839809849 (+4 ms)Writing region close event to WAL at 1675839809850 (+1 ms)Closed at 1675839809850 2023-02-08 07:03:29,852 INFO [M:0;jenkins-hbase4:37997] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 07:03:29,852 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:29,852 INFO [M:0;jenkins-hbase4:37997] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37997 2023-02-08 07:03:29,855 DEBUG [M:0;jenkins-hbase4:37997] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37997,1675839806533 already deleted, retry=false 2023-02-08 07:03:30,006 INFO [M:0;jenkins-hbase4:37997] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37997,1675839806533; zookeeper connection closed. 2023-02-08 07:03:30,006 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:30,007 ERROR [Listener at localhost/40499-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50eaba36 rejected from java.util.concurrent.ThreadPoolExecutor@54d524f3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:30,007 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): master:37997-0x10032be05f10000, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:30,007 ERROR [Listener at localhost/40499-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25b2a4e3 rejected from java.util.concurrent.ThreadPoolExecutor@54d524f3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:30,106 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:30,107 INFO [RS:0;jenkins-hbase4:38691] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38691,1675839806595; zookeeper connection closed. 2023-02-08 07:03:30,107 ERROR [Listener at localhost/40499-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b6cf4a8 rejected from java.util.concurrent.ThreadPoolExecutor@3958ef43[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:30,107 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:38691-0x10032be05f10001, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:30,107 ERROR [Listener at localhost/40499-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@33b0f33f rejected from java.util.concurrent.ThreadPoolExecutor@3958ef43[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:30,107 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3e42b89d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3e42b89d 2023-02-08 07:03:30,207 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:30,207 INFO [RS:1;jenkins-hbase4:42571] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42571,1675839806620; zookeeper connection closed. 2023-02-08 07:03:30,207 ERROR [Listener at localhost/40499-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f339421 rejected from java.util.concurrent.ThreadPoolExecutor@78e27601[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:30,207 DEBUG [Listener at localhost/40499-EventThread] zookeeper.ZKWatcher(600): regionserver:42571-0x10032be05f10002, quorum=127.0.0.1:63226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:30,207 ERROR [Listener at localhost/40499-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@67ae7085 rejected from java.util.concurrent.ThreadPoolExecutor@78e27601[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:30,207 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c5db522] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c5db522 2023-02-08 07:03:30,207 INFO [Listener at localhost/40499] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 07:03:30,208 WARN [Listener at localhost/40499] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:03:30,212 INFO [Listener at localhost/40499] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:30,316 WARN [BP-240678500-172.31.14.131-1675839805962 heartbeating to localhost/127.0.0.1:42793] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:03:30,316 WARN [BP-240678500-172.31.14.131-1675839805962 heartbeating to localhost/127.0.0.1:42793] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-240678500-172.31.14.131-1675839805962 (Datanode Uuid 57426afc-334c-4373-8c60-59faec1fda1d) service to localhost/127.0.0.1:42793 2023-02-08 07:03:30,317 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/cluster_6ae76a4e-d9e1-9db4-8a80-92b9d8a5bc92/dfs/data/data3/current/BP-240678500-172.31.14.131-1675839805962] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:30,317 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/cluster_6ae76a4e-d9e1-9db4-8a80-92b9d8a5bc92/dfs/data/data4/current/BP-240678500-172.31.14.131-1675839805962] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:30,318 WARN [Listener at localhost/40499] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:03:30,321 INFO [Listener at localhost/40499] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:30,416 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-08 07:03:30,504 WARN [BP-240678500-172.31.14.131-1675839805962 heartbeating to localhost/127.0.0.1:42793] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:03:30,504 WARN [BP-240678500-172.31.14.131-1675839805962 heartbeating to localhost/127.0.0.1:42793] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-240678500-172.31.14.131-1675839805962 (Datanode Uuid 37a4935c-f930-4937-afb5-780c0b1b0bfe) service to localhost/127.0.0.1:42793 2023-02-08 07:03:30,504 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/cluster_6ae76a4e-d9e1-9db4-8a80-92b9d8a5bc92/dfs/data/data1/current/BP-240678500-172.31.14.131-1675839805962] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:30,505 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/cluster_6ae76a4e-d9e1-9db4-8a80-92b9d8a5bc92/dfs/data/data2/current/BP-240678500-172.31.14.131-1675839805962] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:30,519 INFO [Listener at localhost/40499] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:30,631 INFO [Listener at localhost/40499] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 07:03:30,645 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 07:03:30,657 INFO [Listener at localhost/40499] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=275 (was 254) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40499 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:42793 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37997,1675839806533)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:42793 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:42793 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:42793 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:42793 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:42793 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:42793 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=587 (was 664), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 269), ProcessCount=165 (was 165), AvailableMemoryMB=4124 (was 4204) 2023-02-08 07:03:30,667 INFO [Listener at localhost/40499] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=275, OpenFileDescriptor=587, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=165, AvailableMemoryMB=4124 2023-02-08 07:03:30,677 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/hadoop.log.dir so I do NOT create it in target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf 2023-02-08 07:03:30,677 WARN [Listener at localhost/40499] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/hadoop.log.dir Erasing configuration value by system value. 2023-02-08 07:03:30,677 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/hadoop.tmp.dir so I do NOT create it in target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf 2023-02-08 07:03:30,677 WARN [Listener at localhost/40499] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb3e2ce8-1e0b-7f72-b2a8-c215482e3530/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-08 07:03:30,677 DEBUG [Listener at localhost/40499] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf 2023-02-08 07:03:30,677 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 07:03:30,677 INFO [Listener at localhost/40499] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/cluster_2790d87b-6f3d-7aed-00f3-ed98e59c4999, deleteOnExit=true 2023-02-08 07:03:30,677 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 07:03:30,677 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/test.cache.data in system properties and HBase conf 2023-02-08 07:03:30,678 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 07:03:30,678 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/hadoop.log.dir in system properties and HBase conf 2023-02-08 07:03:30,678 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 07:03:30,678 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 07:03:30,678 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 07:03:30,678 DEBUG [Listener at localhost/40499] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 07:03:30,678 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:03:30,678 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 07:03:30,678 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 07:03:30,678 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:03:30,679 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 07:03:30,679 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 07:03:30,679 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 07:03:30,679 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:03:30,679 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 07:03:30,679 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/nfs.dump.dir in system properties and HBase conf 2023-02-08 07:03:30,679 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/java.io.tmpdir in system properties and HBase conf 2023-02-08 07:03:30,679 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 07:03:30,679 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 07:03:30,679 INFO [Listener at localhost/40499] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 07:03:30,683 WARN [Listener at localhost/40499] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:03:30,683 WARN [Listener at localhost/40499] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:03:30,720 WARN [Listener at localhost/40499] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:30,722 INFO [Listener at localhost/40499] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:30,726 INFO [Listener at localhost/40499] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/java.io.tmpdir/Jetty_localhost_35961_hdfs____rcisvw/webapp 2023-02-08 07:03:30,817 INFO [Listener at localhost/40499] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35961 2023-02-08 07:03:30,822 WARN [Listener at localhost/40499] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 07:03:30,822 WARN [Listener at localhost/40499] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 07:03:30,862 WARN [Listener at localhost/41971] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:30,876 WARN [Listener at localhost/41971] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:03:30,878 WARN [Listener at localhost/41971] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:30,879 INFO [Listener at localhost/41971] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:30,883 INFO [Listener at localhost/41971] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/java.io.tmpdir/Jetty_localhost_38177_datanode____.2acsel/webapp 2023-02-08 07:03:30,975 INFO [Listener at localhost/41971] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38177 2023-02-08 07:03:30,983 WARN [Listener at localhost/36183] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:31,000 WARN [Listener at localhost/36183] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 07:03:31,002 WARN [Listener at localhost/36183] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 07:03:31,003 INFO [Listener at localhost/36183] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 07:03:31,006 INFO [Listener at localhost/36183] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/java.io.tmpdir/Jetty_localhost_39349_datanode____.giow1z/webapp 2023-02-08 07:03:31,098 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa26f0a7ac0dc1566: Processing first storage report for DS-47550898-53e0-484a-88bc-7184d3d5ab7c from datanode d4d06675-c957-4cef-9017-ea9dbd274d18 2023-02-08 07:03:31,098 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa26f0a7ac0dc1566: from storage DS-47550898-53e0-484a-88bc-7184d3d5ab7c node DatanodeRegistration(127.0.0.1:44969, datanodeUuid=d4d06675-c957-4cef-9017-ea9dbd274d18, infoPort=40373, infoSecurePort=0, ipcPort=36183, storageInfo=lv=-57;cid=testClusterID;nsid=1058695501;c=1675839810686), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:31,098 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa26f0a7ac0dc1566: Processing first storage report for DS-6de7e091-a00f-4152-9083-fc0253c3aedc from datanode d4d06675-c957-4cef-9017-ea9dbd274d18 2023-02-08 07:03:31,098 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa26f0a7ac0dc1566: from storage DS-6de7e091-a00f-4152-9083-fc0253c3aedc node DatanodeRegistration(127.0.0.1:44969, datanodeUuid=d4d06675-c957-4cef-9017-ea9dbd274d18, infoPort=40373, infoSecurePort=0, ipcPort=36183, storageInfo=lv=-57;cid=testClusterID;nsid=1058695501;c=1675839810686), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:31,101 INFO [Listener at localhost/36183] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39349 2023-02-08 07:03:31,108 WARN [Listener at localhost/41999] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 07:03:31,199 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x87f932f41d63a126: Processing first storage report for DS-babd34a8-1785-4962-bb9b-69ebd5ee833d from datanode 8b43fab7-9cab-4ebe-af98-93517171b4d9 2023-02-08 07:03:31,199 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x87f932f41d63a126: from storage DS-babd34a8-1785-4962-bb9b-69ebd5ee833d node DatanodeRegistration(127.0.0.1:34663, datanodeUuid=8b43fab7-9cab-4ebe-af98-93517171b4d9, infoPort=43495, infoSecurePort=0, ipcPort=41999, storageInfo=lv=-57;cid=testClusterID;nsid=1058695501;c=1675839810686), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:31,199 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x87f932f41d63a126: Processing first storage report for DS-3829a989-9ca5-48e8-8135-ae138b2cac60 from datanode 8b43fab7-9cab-4ebe-af98-93517171b4d9 2023-02-08 07:03:31,199 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x87f932f41d63a126: from storage DS-3829a989-9ca5-48e8-8135-ae138b2cac60 node DatanodeRegistration(127.0.0.1:34663, datanodeUuid=8b43fab7-9cab-4ebe-af98-93517171b4d9, infoPort=43495, infoSecurePort=0, ipcPort=41999, storageInfo=lv=-57;cid=testClusterID;nsid=1058695501;c=1675839810686), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 07:03:31,216 DEBUG [Listener at localhost/41999] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf 2023-02-08 07:03:31,217 INFO [Listener at localhost/41999] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/cluster_2790d87b-6f3d-7aed-00f3-ed98e59c4999/zookeeper_0, clientPort=51554, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/cluster_2790d87b-6f3d-7aed-00f3-ed98e59c4999/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/cluster_2790d87b-6f3d-7aed-00f3-ed98e59c4999/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 07:03:31,218 INFO [Listener at localhost/41999] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51554 2023-02-08 07:03:31,219 INFO [Listener at localhost/41999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:31,219 INFO [Listener at localhost/41999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:31,232 INFO [Listener at localhost/41999] util.FSUtils(479): Created version file at hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543 with version=8 2023-02-08 07:03:31,232 INFO [Listener at localhost/41999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:31,233 INFO [Listener at localhost/41999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:31,234 INFO [Listener at localhost/41999] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41971/user/jenkins/test-data/a8372956-f942-59db-fe79-31e2122dcf99/hbase-staging 2023-02-08 07:03:31,236 INFO [Listener at localhost/41999] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:31,236 INFO [Listener at localhost/41999] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:31,236 INFO [Listener at localhost/41999] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:31,236 INFO [Listener at localhost/41999] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:31,236 INFO [Listener at localhost/41999] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:31,236 INFO [Listener at localhost/41999] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:31,236 INFO [Listener at localhost/41999] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:31,237 INFO [Listener at localhost/41999] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39145 2023-02-08 07:03:31,237 INFO [Listener at localhost/41999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:31,238 INFO [Listener at localhost/41999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:31,239 INFO [Listener at localhost/41999] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39145 connecting to ZooKeeper ensemble=127.0.0.1:51554 2023-02-08 07:03:31,245 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:391450x0, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:31,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39145-0x10032be18560000 connected 2023-02-08 07:03:31,266 DEBUG [Listener at localhost/41999] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:31,266 DEBUG [Listener at localhost/41999] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:31,267 DEBUG [Listener at localhost/41999] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:31,268 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39145 2023-02-08 07:03:31,268 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39145 2023-02-08 07:03:31,271 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39145 2023-02-08 07:03:31,271 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39145 2023-02-08 07:03:31,272 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39145 2023-02-08 07:03:31,272 INFO [Listener at localhost/41999] master.HMaster(439): hbase.rootdir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543, hbase.cluster.distributed=false 2023-02-08 07:03:31,287 INFO [Listener at localhost/41999] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:31,287 INFO [Listener at localhost/41999] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:31,287 INFO [Listener at localhost/41999] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:31,288 INFO [Listener at localhost/41999] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:31,288 INFO [Listener at localhost/41999] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:31,288 INFO [Listener at localhost/41999] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:31,288 INFO [Listener at localhost/41999] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:31,288 INFO [Listener at localhost/41999] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34803 2023-02-08 07:03:31,289 INFO [Listener at localhost/41999] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:03:31,289 DEBUG [Listener at localhost/41999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:31,290 INFO [Listener at localhost/41999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:31,291 INFO [Listener at localhost/41999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:31,292 INFO [Listener at localhost/41999] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34803 connecting to ZooKeeper ensemble=127.0.0.1:51554 2023-02-08 07:03:31,294 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:348030x0, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:31,294 DEBUG [Listener at localhost/41999] zookeeper.ZKUtil(164): regionserver:348030x0, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:31,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34803-0x10032be18560001 connected 2023-02-08 07:03:31,297 DEBUG [Listener at localhost/41999] zookeeper.ZKUtil(164): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:31,298 DEBUG [Listener at localhost/41999] zookeeper.ZKUtil(164): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:31,298 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34803 2023-02-08 07:03:31,299 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34803 2023-02-08 07:03:31,299 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34803 2023-02-08 07:03:31,303 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34803 2023-02-08 07:03:31,304 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34803 2023-02-08 07:03:31,314 INFO [Listener at localhost/41999] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 07:03:31,314 INFO [Listener at localhost/41999] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:31,314 INFO [Listener at localhost/41999] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:31,314 INFO [Listener at localhost/41999] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 07:03:31,314 INFO [Listener at localhost/41999] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 07:03:31,314 INFO [Listener at localhost/41999] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 07:03:31,315 INFO [Listener at localhost/41999] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 07:03:31,315 INFO [Listener at localhost/41999] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37255 2023-02-08 07:03:31,315 INFO [Listener at localhost/41999] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 07:03:31,318 DEBUG [Listener at localhost/41999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:31,319 INFO [Listener at localhost/41999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:31,319 INFO [Listener at localhost/41999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:31,320 INFO [Listener at localhost/41999] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37255 connecting to ZooKeeper ensemble=127.0.0.1:51554 2023-02-08 07:03:31,322 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:372550x0, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 07:03:31,323 DEBUG [Listener at localhost/41999] zookeeper.ZKUtil(164): regionserver:372550x0, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:31,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37255-0x10032be18560002 connected 2023-02-08 07:03:31,324 DEBUG [Listener at localhost/41999] zookeeper.ZKUtil(164): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:31,324 DEBUG [Listener at localhost/41999] zookeeper.ZKUtil(164): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 07:03:31,329 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37255 2023-02-08 07:03:31,329 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37255 2023-02-08 07:03:31,329 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37255 2023-02-08 07:03:31,329 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37255 2023-02-08 07:03:31,332 DEBUG [Listener at localhost/41999] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37255 2023-02-08 07:03:31,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39145,1675839811235 2023-02-08 07:03:31,335 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:03:31,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39145,1675839811235 2023-02-08 07:03:31,337 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:31,337 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:31,337 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:31,337 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:31,339 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:03:31,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 07:03:31,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39145,1675839811235 from backup master directory 2023-02-08 07:03:31,341 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39145,1675839811235 2023-02-08 07:03:31,341 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 07:03:31,341 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:31,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,39145,1675839811235 2023-02-08 07:03:31,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/hbase.id with ID: 2811fec8-62b8-4570-8482-5f5a6f88af18 2023-02-08 07:03:31,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 07:03:31,364 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:31,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x47d77e21 to 127.0.0.1:51554 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:31,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51cfc055, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:31,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:31,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 07:03:31,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:31,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/data/master/store-tmp 2023-02-08 07:03:31,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:31,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:03:31,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:31,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:31,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:03:31,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:31,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:31,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839811387Disabling compacts and flushes for region at 1675839811387Disabling writes for close at 1675839811387Writing region close event to WAL at 1675839811387Closed at 1675839811387 2023-02-08 07:03:31,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/WALs/jenkins-hbase4.apache.org,39145,1675839811235 2023-02-08 07:03:31,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39145%2C1675839811235, suffix=, logDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/WALs/jenkins-hbase4.apache.org,39145,1675839811235, archiveDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/oldWALs, maxLogs=10 2023-02-08 07:03:31,401 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44969,DS-47550898-53e0-484a-88bc-7184d3d5ab7c,DISK] 2023-02-08 07:03:31,401 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34663,DS-babd34a8-1785-4962-bb9b-69ebd5ee833d,DISK] 2023-02-08 07:03:31,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/WALs/jenkins-hbase4.apache.org,39145,1675839811235/jenkins-hbase4.apache.org%2C39145%2C1675839811235.1675839811390 2023-02-08 07:03:31,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44969,DS-47550898-53e0-484a-88bc-7184d3d5ab7c,DISK], DatanodeInfoWithStorage[127.0.0.1:34663,DS-babd34a8-1785-4962-bb9b-69ebd5ee833d,DISK]] 2023-02-08 07:03:31,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:31,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:31,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:31,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:31,405 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:31,406 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 07:03:31,406 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 07:03:31,407 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:31,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:31,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:31,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 07:03:31,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:31,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65748808, jitterRate=-0.020266413688659668}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:03:31,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675839811404Initializing all the Stores at 1675839811405 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839811405Cleaning up temporary data from old regions at 1675839811408 (+3 ms)Cleaning up detritus from prior splits at 1675839811408Region opened successfully at 1675839811411 (+3 ms) 2023-02-08 07:03:31,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 07:03:31,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 07:03:31,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 07:03:31,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 07:03:31,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-08 07:03:31,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-08 07:03:31,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 07:03:31,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 07:03:31,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 07:03:31,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 07:03:31,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 07:03:31,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 07:03:31,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 07:03:31,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 07:03:31,427 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:31,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 07:03:31,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 07:03:31,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 07:03:31,430 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:31,430 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:31,430 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:31,430 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:31,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,39145,1675839811235, sessionid=0x10032be18560000, setting cluster-up flag (Was=false) 2023-02-08 07:03:31,435 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:31,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 07:03:31,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39145,1675839811235 2023-02-08 07:03:31,442 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:31,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 07:03:31,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39145,1675839811235 2023-02-08 07:03:31,447 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.hbase-snapshot/.tmp 2023-02-08 07:03:31,448 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:31,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:31,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:31,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:31,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 07:03:31,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 07:03:31,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:31,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675839841452 2023-02-08 07:03:31,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 07:03:31,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 07:03:31,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 07:03:31,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 07:03:31,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 07:03:31,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 07:03:31,453 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:31,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,453 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 07:03:31,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 07:03:31,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 07:03:31,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 07:03:31,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 07:03:31,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 07:03:31,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839811454,5,FailOnTimeoutGroup] 2023-02-08 07:03:31,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839811454,5,FailOnTimeoutGroup] 2023-02-08 07:03:31,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 07:03:31,454 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:31,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,464 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:31,465 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:31,465 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543 2023-02-08 07:03:31,473 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:31,474 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:03:31,475 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/info 2023-02-08 07:03:31,475 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:03:31,476 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:31,476 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:03:31,477 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:31,477 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:03:31,477 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:31,477 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:03:31,478 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/table 2023-02-08 07:03:31,478 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:03:31,478 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:31,479 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740 2023-02-08 07:03:31,479 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740 2023-02-08 07:03:31,481 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:03:31,481 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:03:31,484 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:31,484 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74502308, jitterRate=0.11017090082168579}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:03:31,484 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675839811473Initializing all the Stores at 1675839811474 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839811474Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839811474Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839811474Cleaning up temporary data from old regions at 1675839811480 (+6 ms)Cleaning up detritus from prior splits at 1675839811480Region opened successfully at 1675839811484 (+4 ms) 2023-02-08 07:03:31,485 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:03:31,485 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:03:31,485 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:03:31,485 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:03:31,485 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:03:31,485 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:31,485 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839811485Disabling compacts and flushes for region at 1675839811485Disabling writes for close at 1675839811485Writing region close event to WAL at 1675839811485Closed at 1675839811485 2023-02-08 07:03:31,485 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 07:03:31,486 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 07:03:31,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 07:03:31,489 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 07:03:31,490 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 07:03:31,534 INFO [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(952): ClusterId : 2811fec8-62b8-4570-8482-5f5a6f88af18 2023-02-08 07:03:31,534 INFO [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(952): ClusterId : 2811fec8-62b8-4570-8482-5f5a6f88af18 2023-02-08 07:03:31,534 DEBUG [RS:1;jenkins-hbase4:37255] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:03:31,534 DEBUG [RS:0;jenkins-hbase4:34803] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 07:03:31,536 DEBUG [RS:1;jenkins-hbase4:37255] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:03:31,536 DEBUG [RS:1;jenkins-hbase4:37255] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:03:31,536 DEBUG [RS:0;jenkins-hbase4:34803] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 07:03:31,536 DEBUG [RS:0;jenkins-hbase4:34803] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 07:03:31,538 DEBUG [RS:1;jenkins-hbase4:37255] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:03:31,538 DEBUG [RS:0;jenkins-hbase4:34803] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 07:03:31,539 DEBUG [RS:1;jenkins-hbase4:37255] zookeeper.ReadOnlyZKClient(139): Connect 0x565b818c to 127.0.0.1:51554 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:31,539 DEBUG [RS:0;jenkins-hbase4:34803] zookeeper.ReadOnlyZKClient(139): Connect 0x561cc219 to 127.0.0.1:51554 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:31,544 DEBUG [RS:1;jenkins-hbase4:37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@589c6537, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:31,544 DEBUG [RS:0;jenkins-hbase4:34803] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58db26aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:31,544 DEBUG [RS:1;jenkins-hbase4:37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ca3eafc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:31,544 DEBUG [RS:0;jenkins-hbase4:34803] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ce4a969, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:31,552 DEBUG [RS:0;jenkins-hbase4:34803] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34803 2023-02-08 07:03:31,552 DEBUG [RS:1;jenkins-hbase4:37255] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37255 2023-02-08 07:03:31,552 INFO [RS:0;jenkins-hbase4:34803] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:03:31,552 INFO [RS:0;jenkins-hbase4:34803] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:03:31,552 INFO [RS:1;jenkins-hbase4:37255] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 07:03:31,553 INFO [RS:1;jenkins-hbase4:37255] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 07:03:31,553 DEBUG [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:03:31,553 DEBUG [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 07:03:31,553 INFO [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39145,1675839811235 with isa=jenkins-hbase4.apache.org/172.31.14.131:34803, startcode=1675839811287 2023-02-08 07:03:31,553 INFO [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39145,1675839811235 with isa=jenkins-hbase4.apache.org/172.31.14.131:37255, startcode=1675839811314 2023-02-08 07:03:31,553 DEBUG [RS:0;jenkins-hbase4:34803] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:03:31,553 DEBUG [RS:1;jenkins-hbase4:37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 07:03:31,555 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47841, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:03:31,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:31,556 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48075, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 07:03:31,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:31,557 DEBUG [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543 2023-02-08 07:03:31,557 DEBUG [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41971 2023-02-08 07:03:31,557 DEBUG [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:03:31,557 DEBUG [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543 2023-02-08 07:03:31,557 DEBUG [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41971 2023-02-08 07:03:31,557 DEBUG [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 07:03:31,558 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:31,562 DEBUG [RS:0;jenkins-hbase4:34803] zookeeper.ZKUtil(162): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:31,562 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37255,1675839811314] 2023-02-08 07:03:31,562 WARN [RS:0;jenkins-hbase4:34803] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:31,562 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34803,1675839811287] 2023-02-08 07:03:31,562 DEBUG [RS:1;jenkins-hbase4:37255] zookeeper.ZKUtil(162): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:31,562 INFO [RS:0;jenkins-hbase4:34803] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:31,562 WARN [RS:1;jenkins-hbase4:37255] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 07:03:31,562 DEBUG [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/WALs/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:31,562 INFO [RS:1;jenkins-hbase4:37255] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:31,562 DEBUG [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/WALs/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:31,569 DEBUG [RS:0;jenkins-hbase4:34803] zookeeper.ZKUtil(162): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:31,569 DEBUG [RS:1;jenkins-hbase4:37255] zookeeper.ZKUtil(162): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:31,569 DEBUG [RS:0;jenkins-hbase4:34803] zookeeper.ZKUtil(162): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:31,569 DEBUG [RS:1;jenkins-hbase4:37255] zookeeper.ZKUtil(162): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:31,570 DEBUG [RS:0;jenkins-hbase4:34803] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:03:31,570 DEBUG [RS:1;jenkins-hbase4:37255] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 07:03:31,570 INFO [RS:0;jenkins-hbase4:34803] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:03:31,570 INFO [RS:1;jenkins-hbase4:37255] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 07:03:31,572 INFO [RS:0;jenkins-hbase4:34803] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:03:31,572 INFO [RS:0;jenkins-hbase4:34803] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:03:31,572 INFO [RS:0;jenkins-hbase4:34803] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,572 INFO [RS:1;jenkins-hbase4:37255] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 07:03:31,572 INFO [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:03:31,576 INFO [RS:1;jenkins-hbase4:37255] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 07:03:31,576 INFO [RS:1;jenkins-hbase4:37255] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,576 INFO [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 07:03:31,577 INFO [RS:0;jenkins-hbase4:34803] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,578 DEBUG [RS:0;jenkins-hbase4:34803] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,578 DEBUG [RS:0;jenkins-hbase4:34803] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,578 DEBUG [RS:0;jenkins-hbase4:34803] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,578 INFO [RS:1;jenkins-hbase4:37255] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,578 DEBUG [RS:0;jenkins-hbase4:34803] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,578 DEBUG [RS:0;jenkins-hbase4:34803] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:1;jenkins-hbase4:37255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:0;jenkins-hbase4:34803] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:31,580 DEBUG [RS:1;jenkins-hbase4:37255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:0;jenkins-hbase4:34803] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:1;jenkins-hbase4:37255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:0;jenkins-hbase4:34803] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:1;jenkins-hbase4:37255] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:0;jenkins-hbase4:34803] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:1;jenkins-hbase4:37255] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:0;jenkins-hbase4:34803] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:1;jenkins-hbase4:37255] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 07:03:31,580 DEBUG [RS:1;jenkins-hbase4:37255] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:1;jenkins-hbase4:37255] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:1;jenkins-hbase4:37255] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,580 DEBUG [RS:1;jenkins-hbase4:37255] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 07:03:31,583 INFO [RS:0;jenkins-hbase4:34803] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,583 INFO [RS:0;jenkins-hbase4:34803] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,584 INFO [RS:0;jenkins-hbase4:34803] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,584 INFO [RS:1;jenkins-hbase4:37255] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,584 INFO [RS:1;jenkins-hbase4:37255] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,584 INFO [RS:1;jenkins-hbase4:37255] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,594 INFO [RS:0;jenkins-hbase4:34803] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:03:31,594 INFO [RS:0;jenkins-hbase4:34803] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34803,1675839811287-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,597 INFO [RS:1;jenkins-hbase4:37255] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 07:03:31,597 INFO [RS:1;jenkins-hbase4:37255] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37255,1675839811314-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,605 INFO [RS:0;jenkins-hbase4:34803] regionserver.Replication(203): jenkins-hbase4.apache.org,34803,1675839811287 started 2023-02-08 07:03:31,605 INFO [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34803,1675839811287, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34803, sessionid=0x10032be18560001 2023-02-08 07:03:31,605 DEBUG [RS:0;jenkins-hbase4:34803] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:03:31,605 DEBUG [RS:0;jenkins-hbase4:34803] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:31,605 DEBUG [RS:0;jenkins-hbase4:34803] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34803,1675839811287' 2023-02-08 07:03:31,605 DEBUG [RS:0;jenkins-hbase4:34803] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:31,605 DEBUG [RS:0;jenkins-hbase4:34803] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:31,606 DEBUG [RS:0;jenkins-hbase4:34803] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:03:31,606 DEBUG [RS:0;jenkins-hbase4:34803] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:03:31,606 DEBUG [RS:0;jenkins-hbase4:34803] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:31,606 DEBUG [RS:0;jenkins-hbase4:34803] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34803,1675839811287' 2023-02-08 07:03:31,606 DEBUG [RS:0;jenkins-hbase4:34803] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:31,606 DEBUG [RS:0;jenkins-hbase4:34803] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:31,606 DEBUG [RS:0;jenkins-hbase4:34803] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:03:31,606 INFO [RS:0;jenkins-hbase4:34803] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:03:31,606 INFO [RS:0;jenkins-hbase4:34803] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:03:31,608 INFO [RS:1;jenkins-hbase4:37255] regionserver.Replication(203): jenkins-hbase4.apache.org,37255,1675839811314 started 2023-02-08 07:03:31,608 INFO [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37255,1675839811314, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37255, sessionid=0x10032be18560002 2023-02-08 07:03:31,608 DEBUG [RS:1;jenkins-hbase4:37255] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 07:03:31,608 DEBUG [RS:1;jenkins-hbase4:37255] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:31,608 DEBUG [RS:1;jenkins-hbase4:37255] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37255,1675839811314' 2023-02-08 07:03:31,608 DEBUG [RS:1;jenkins-hbase4:37255] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:31,608 DEBUG [RS:1;jenkins-hbase4:37255] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:31,609 DEBUG [RS:1;jenkins-hbase4:37255] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 07:03:31,609 DEBUG [RS:1;jenkins-hbase4:37255] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 07:03:31,609 DEBUG [RS:1;jenkins-hbase4:37255] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:31,609 DEBUG [RS:1;jenkins-hbase4:37255] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37255,1675839811314' 2023-02-08 07:03:31,609 DEBUG [RS:1;jenkins-hbase4:37255] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:31,609 DEBUG [RS:1;jenkins-hbase4:37255] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:31,609 DEBUG [RS:1;jenkins-hbase4:37255] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 07:03:31,609 INFO [RS:1;jenkins-hbase4:37255] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 07:03:31,609 INFO [RS:1;jenkins-hbase4:37255] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 07:03:31,640 DEBUG [jenkins-hbase4:39145] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 07:03:31,640 DEBUG [jenkins-hbase4:39145] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:31,641 DEBUG [jenkins-hbase4:39145] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:31,641 DEBUG [jenkins-hbase4:39145] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:31,641 DEBUG [jenkins-hbase4:39145] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:31,641 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37255,1675839811314, state=OPENING 2023-02-08 07:03:31,644 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 07:03:31,645 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:31,645 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:03:31,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37255,1675839811314}] 2023-02-08 07:03:31,800 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:31,800 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:03:31,801 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33220, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:03:31,804 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 07:03:31,804 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 07:03:31,806 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37255%2C1675839811314.meta, suffix=.meta, logDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/WALs/jenkins-hbase4.apache.org,37255,1675839811314, archiveDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/oldWALs, maxLogs=32 2023-02-08 07:03:31,820 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34663,DS-babd34a8-1785-4962-bb9b-69ebd5ee833d,DISK] 2023-02-08 07:03:31,820 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44969,DS-47550898-53e0-484a-88bc-7184d3d5ab7c,DISK] 2023-02-08 07:03:31,821 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/WALs/jenkins-hbase4.apache.org,37255,1675839811314/jenkins-hbase4.apache.org%2C37255%2C1675839811314.meta.1675839811806.meta 2023-02-08 07:03:31,821 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44969,DS-47550898-53e0-484a-88bc-7184d3d5ab7c,DISK], DatanodeInfoWithStorage[127.0.0.1:34663,DS-babd34a8-1785-4962-bb9b-69ebd5ee833d,DISK]] 2023-02-08 07:03:31,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:31,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 07:03:31,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 07:03:31,822 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 07:03:31,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 07:03:31,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:31,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 07:03:31,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 07:03:31,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 07:03:31,824 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/info 2023-02-08 07:03:31,824 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/info 2023-02-08 07:03:31,824 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 07:03:31,825 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:31,825 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 07:03:31,825 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:31,826 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/rep_barrier 2023-02-08 07:03:31,826 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 07:03:31,826 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:31,826 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 07:03:31,827 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/table 2023-02-08 07:03:31,827 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/table 2023-02-08 07:03:31,827 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 07:03:31,827 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:31,828 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740 2023-02-08 07:03:31,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740 2023-02-08 07:03:31,830 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 07:03:31,831 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 07:03:31,831 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71204909, jitterRate=0.06103582680225372}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 07:03:31,831 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675839811823Writing region info on filesystem at 1675839811823Initializing all the Stores at 1675839811823Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839811823Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839811823Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839811823Cleaning up temporary data from old regions at 1675839811829 (+6 ms)Cleaning up detritus from prior splits at 1675839811829Running coprocessor post-open hooks at 1675839811831 (+2 ms)Region opened successfully at 1675839811831 2023-02-08 07:03:31,832 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675839811799 2023-02-08 07:03:31,835 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 07:03:31,837 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 07:03:31,837 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37255,1675839811314, state=OPEN 2023-02-08 07:03:31,838 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 07:03:31,839 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 07:03:31,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 07:03:31,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37255,1675839811314 in 194 msec 2023-02-08 07:03:31,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 07:03:31,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 354 msec 2023-02-08 07:03:31,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 393 msec 2023-02-08 07:03:31,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675839811336, completionTime=-1 2023-02-08 07:03:31,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 07:03:31,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 07:03:31,845 DEBUG [hconnection-0x26209d94-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:31,846 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33222, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:31,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 07:03:31,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675839871847 2023-02-08 07:03:31,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675839931847 2023-02-08 07:03:31,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-08 07:03:31,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39145,1675839811235-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39145,1675839811235-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39145,1675839811235-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39145, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 07:03:31,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 07:03:31,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:31,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 07:03:31,854 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 07:03:31,855 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:03:31,855 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:03:31,856 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63 2023-02-08 07:03:31,857 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63 empty. 2023-02-08 07:03:31,857 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63 2023-02-08 07:03:31,857 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 07:03:31,868 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:31,869 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1d8776d122eee6c4feeeb6d7126ddd63, NAME => 'hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp 2023-02-08 07:03:31,878 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:31,879 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 1d8776d122eee6c4feeeb6d7126ddd63, disabling compactions & flushes 2023-02-08 07:03:31,879 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. 2023-02-08 07:03:31,879 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. 2023-02-08 07:03:31,879 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. after waiting 0 ms 2023-02-08 07:03:31,879 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. 2023-02-08 07:03:31,879 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. 2023-02-08 07:03:31,879 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 1d8776d122eee6c4feeeb6d7126ddd63: Waiting for close lock at 1675839811879Disabling compacts and flushes for region at 1675839811879Disabling writes for close at 1675839811879Writing region close event to WAL at 1675839811879Closed at 1675839811879 2023-02-08 07:03:31,881 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:03:31,881 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839811881"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839811881"}]},"ts":"1675839811881"} 2023-02-08 07:03:31,882 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 07:03:31,883 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:03:31,883 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839811883"}]},"ts":"1675839811883"} 2023-02-08 07:03:31,884 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 07:03:31,886 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:31,887 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:31,887 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:31,887 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:31,887 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1d8776d122eee6c4feeeb6d7126ddd63, ASSIGN}] 2023-02-08 07:03:31,889 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1d8776d122eee6c4feeeb6d7126ddd63, ASSIGN 2023-02-08 07:03:31,890 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1d8776d122eee6c4feeeb6d7126ddd63, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34803,1675839811287; forceNewPlan=false, retain=false 2023-02-08 07:03:32,040 INFO [jenkins-hbase4:39145] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 07:03:32,040 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1d8776d122eee6c4feeeb6d7126ddd63, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:32,040 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839812040"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839812040"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839812040"}]},"ts":"1675839812040"} 2023-02-08 07:03:32,042 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1d8776d122eee6c4feeeb6d7126ddd63, server=jenkins-hbase4.apache.org,34803,1675839811287}] 2023-02-08 07:03:32,195 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:32,195 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 07:03:32,196 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47558, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 07:03:32,200 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. 2023-02-08 07:03:32,201 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34803%2C1675839811287, suffix=, logDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/WALs/jenkins-hbase4.apache.org,34803,1675839811287, archiveDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/oldWALs, maxLogs=32 2023-02-08 07:03:32,214 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34663,DS-babd34a8-1785-4962-bb9b-69ebd5ee833d,DISK] 2023-02-08 07:03:32,214 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44969,DS-47550898-53e0-484a-88bc-7184d3d5ab7c,DISK] 2023-02-08 07:03:32,216 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/WALs/jenkins-hbase4.apache.org,34803,1675839811287/jenkins-hbase4.apache.org%2C34803%2C1675839811287.1675839812201 2023-02-08 07:03:32,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44969,DS-47550898-53e0-484a-88bc-7184d3d5ab7c,DISK], DatanodeInfoWithStorage[127.0.0.1:34663,DS-babd34a8-1785-4962-bb9b-69ebd5ee833d,DISK]] 2023-02-08 07:03:32,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1d8776d122eee6c4feeeb6d7126ddd63, NAME => 'hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:32,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1d8776d122eee6c4feeeb6d7126ddd63 2023-02-08 07:03:32,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:32,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1d8776d122eee6c4feeeb6d7126ddd63 2023-02-08 07:03:32,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1d8776d122eee6c4feeeb6d7126ddd63 2023-02-08 07:03:32,217 INFO [StoreOpener-1d8776d122eee6c4feeeb6d7126ddd63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1d8776d122eee6c4feeeb6d7126ddd63 2023-02-08 07:03:32,218 DEBUG [StoreOpener-1d8776d122eee6c4feeeb6d7126ddd63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63/info 2023-02-08 07:03:32,218 DEBUG [StoreOpener-1d8776d122eee6c4feeeb6d7126ddd63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63/info 2023-02-08 07:03:32,219 INFO [StoreOpener-1d8776d122eee6c4feeeb6d7126ddd63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d8776d122eee6c4feeeb6d7126ddd63 columnFamilyName info 2023-02-08 07:03:32,219 INFO [StoreOpener-1d8776d122eee6c4feeeb6d7126ddd63-1] regionserver.HStore(310): Store=1d8776d122eee6c4feeeb6d7126ddd63/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:32,220 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63 2023-02-08 07:03:32,220 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63 2023-02-08 07:03:32,222 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1d8776d122eee6c4feeeb6d7126ddd63 2023-02-08 07:03:32,223 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:32,223 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1d8776d122eee6c4feeeb6d7126ddd63; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69962080, jitterRate=0.042516231536865234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 07:03:32,223 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1d8776d122eee6c4feeeb6d7126ddd63: Running coprocessor pre-open hook at 1675839812216Writing region info on filesystem at 1675839812216Initializing all the Stores at 1675839812217 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675839812217Cleaning up temporary data from old regions at 1675839812220 (+3 ms)Cleaning up detritus from prior splits at 1675839812220Running coprocessor post-open hooks at 1675839812223 (+3 ms)Region opened successfully at 1675839812223 2023-02-08 07:03:32,224 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63., pid=6, masterSystemTime=1675839812195 2023-02-08 07:03:32,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. 2023-02-08 07:03:32,227 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. 2023-02-08 07:03:32,227 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1d8776d122eee6c4feeeb6d7126ddd63, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:32,227 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675839812227"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839812227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839812227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839812227"}]},"ts":"1675839812227"} 2023-02-08 07:03:32,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 07:03:32,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1d8776d122eee6c4feeeb6d7126ddd63, server=jenkins-hbase4.apache.org,34803,1675839811287 in 186 msec 2023-02-08 07:03:32,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 07:03:32,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1d8776d122eee6c4feeeb6d7126ddd63, ASSIGN in 342 msec 2023-02-08 07:03:32,231 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:03:32,231 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839812231"}]},"ts":"1675839812231"} 2023-02-08 07:03:32,232 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 07:03:32,234 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:03:32,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 381 msec 2023-02-08 07:03:32,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 07:03:32,256 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:32,256 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:32,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:32,259 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47560, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:32,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 07:03:32,266 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:32,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 7 msec 2023-02-08 07:03:32,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 07:03:32,277 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 07:03:32,279 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-08 07:03:32,285 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 07:03:32,288 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 07:03:32,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.947sec 2023-02-08 07:03:32,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 07:03:32,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 07:03:32,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 07:03:32,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39145,1675839811235-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 07:03:32,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39145,1675839811235-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 07:03:32,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 07:03:32,334 DEBUG [Listener at localhost/41999] zookeeper.ReadOnlyZKClient(139): Connect 0x6f24deed to 127.0.0.1:51554 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:32,337 DEBUG [Listener at localhost/41999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46d49f13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:32,339 DEBUG [hconnection-0x48af50a8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:32,340 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33224, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:32,341 INFO [Listener at localhost/41999] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39145,1675839811235 2023-02-08 07:03:32,341 DEBUG [Listener at localhost/41999] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 07:03:32,341 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:32,341 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:32,343 DEBUG [Listener at localhost/41999] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 07:03:32,345 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59664, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 07:03:32,345 INFO [Listener at localhost/41999] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-08 07:03:32,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-08 07:03:32,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 07:03:32,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:59664 deadline: 1675839872345, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-08 07:03:32,346 INFO [Listener at localhost/41999] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-08 07:03:32,346 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:32,346 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:32,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 07:03:32,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-08 07:03:32,350 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 07:03:32,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-08 07:03:32,350 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:32,351 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:32,351 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 07:03:32,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:32,352 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:32,352 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4 empty. 2023-02-08 07:03:32,353 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:32,353 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-08 07:03:32,362 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-08 07:03:32,363 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 77cf44c92203d3baac7a181cd62fd8a4, NAME => 'testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp 2023-02-08 07:03:32,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:32,369 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 77cf44c92203d3baac7a181cd62fd8a4, disabling compactions & flushes 2023-02-08 07:03:32,369 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:32,369 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:32,369 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. after waiting 0 ms 2023-02-08 07:03:32,369 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:32,369 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:32,369 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 77cf44c92203d3baac7a181cd62fd8a4: Waiting for close lock at 1675839812369Disabling compacts and flushes for region at 1675839812369Disabling writes for close at 1675839812369Writing region close event to WAL at 1675839812369Closed at 1675839812369 2023-02-08 07:03:32,370 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 07:03:32,371 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675839812371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839812371"}]},"ts":"1675839812371"} 2023-02-08 07:03:32,372 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 07:03:32,373 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 07:03:32,373 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839812373"}]},"ts":"1675839812373"} 2023-02-08 07:03:32,374 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-08 07:03:32,377 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 07:03:32,378 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 07:03:32,378 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 07:03:32,378 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 07:03:32,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=77cf44c92203d3baac7a181cd62fd8a4, ASSIGN}] 2023-02-08 07:03:32,379 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=77cf44c92203d3baac7a181cd62fd8a4, ASSIGN 2023-02-08 07:03:32,379 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=77cf44c92203d3baac7a181cd62fd8a4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37255,1675839811314; forceNewPlan=false, retain=false 2023-02-08 07:03:32,451 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:32,452 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:32,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:32,529 INFO [jenkins-hbase4:39145] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 07:03:32,530 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=77cf44c92203d3baac7a181cd62fd8a4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:32,530 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675839812530"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839812530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839812530"}]},"ts":"1675839812530"} 2023-02-08 07:03:32,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 77cf44c92203d3baac7a181cd62fd8a4, server=jenkins-hbase4.apache.org,37255,1675839811314}] 2023-02-08 07:03:32,610 INFO [RS:1;jenkins-hbase4:37255] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37255%2C1675839811314, suffix=, logDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/WALs/jenkins-hbase4.apache.org,37255,1675839811314, archiveDir=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/oldWALs, maxLogs=32 2023-02-08 07:03:32,623 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44969,DS-47550898-53e0-484a-88bc-7184d3d5ab7c,DISK] 2023-02-08 07:03:32,623 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34663,DS-babd34a8-1785-4962-bb9b-69ebd5ee833d,DISK] 2023-02-08 07:03:32,625 INFO [RS:1;jenkins-hbase4:37255] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/WALs/jenkins-hbase4.apache.org,37255,1675839811314/jenkins-hbase4.apache.org%2C37255%2C1675839811314.1675839812611 2023-02-08 07:03:32,625 DEBUG [RS:1;jenkins-hbase4:37255] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44969,DS-47550898-53e0-484a-88bc-7184d3d5ab7c,DISK], DatanodeInfoWithStorage[127.0.0.1:34663,DS-babd34a8-1785-4962-bb9b-69ebd5ee833d,DISK]] 2023-02-08 07:03:32,653 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:32,653 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:32,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:32,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:32,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 77cf44c92203d3baac7a181cd62fd8a4, NAME => 'testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.', STARTKEY => '', ENDKEY => ''} 2023-02-08 07:03:32,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:32,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:32,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:32,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:32,688 INFO [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:32,689 DEBUG [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1 2023-02-08 07:03:32,689 DEBUG [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1 2023-02-08 07:03:32,689 INFO [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77cf44c92203d3baac7a181cd62fd8a4 columnFamilyName f1 2023-02-08 07:03:32,690 INFO [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] regionserver.HStore(310): Store=77cf44c92203d3baac7a181cd62fd8a4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:32,690 INFO [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:32,691 DEBUG [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2 2023-02-08 07:03:32,691 DEBUG [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2 2023-02-08 07:03:32,691 INFO [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77cf44c92203d3baac7a181cd62fd8a4 columnFamilyName f2 2023-02-08 07:03:32,692 INFO [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] regionserver.HStore(310): Store=77cf44c92203d3baac7a181cd62fd8a4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:32,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:32,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:32,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:32,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:32,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 07:03:32,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 77cf44c92203d3baac7a181cd62fd8a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64928309, jitterRate=-0.032492801547050476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:32,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 77cf44c92203d3baac7a181cd62fd8a4: Running coprocessor pre-open hook at 1675839812687Writing region info on filesystem at 1675839812687Initializing all the Stores at 1675839812687Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839812688 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839812688Cleaning up temporary data from old regions at 1675839812693 (+5 ms)Cleaning up detritus from prior splits at 1675839812694 (+1 ms)Running coprocessor post-open hooks at 1675839812697 (+3 ms)Region opened successfully at 1675839812697 2023-02-08 07:03:32,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4., pid=12, masterSystemTime=1675839812683 2023-02-08 07:03:32,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:32,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:32,701 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=77cf44c92203d3baac7a181cd62fd8a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:32,701 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675839812701"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675839812701"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675839812701"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675839812701"}]},"ts":"1675839812701"} 2023-02-08 07:03:32,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-08 07:03:32,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 77cf44c92203d3baac7a181cd62fd8a4, server=jenkins-hbase4.apache.org,37255,1675839811314 in 171 msec 2023-02-08 07:03:32,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-08 07:03:32,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=77cf44c92203d3baac7a181cd62fd8a4, ASSIGN in 325 msec 2023-02-08 07:03:32,705 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 07:03:32,705 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839812705"}]},"ts":"1675839812705"} 2023-02-08 07:03:32,706 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-08 07:03:32,708 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 07:03:32,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 360 msec 2023-02-08 07:03:32,954 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:32,955 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:32,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 07:03:32,956 INFO [Listener at localhost/41999] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-08 07:03:32,956 DEBUG [Listener at localhost/41999] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-08 07:03:32,956 INFO [Listener at localhost/41999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:03:32,958 INFO [Listener at localhost/41999] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-08 07:03:32,958 INFO [Listener at localhost/41999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 07:03:32,958 INFO [Listener at localhost/41999] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-08 07:03:32,958 INFO [Listener at localhost/41999] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 07:03:32,991 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:33,070 INFO [Listener at localhost/41999] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 07:03:33,070 INFO [Listener at localhost/41999] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 07:03:33,070 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:33,070 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:33,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 07:03:33,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675839813071 (current time:1675839813071). 2023-02-08 07:03:33,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 07:03:33,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] zookeeper.ReadOnlyZKClient(139): Connect 0x1761cb51 to 127.0.0.1:51554 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 07:03:33,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c9f6923, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 07:03:33,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 07:03:33,077 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33228, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 07:03:33,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1761cb51 to 127.0.0.1:51554 2023-02-08 07:03:33,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:33,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 07:03:33,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 07:03:33,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 07:03:33,081 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 07:03:33,082 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675840413082 2023-02-08 07:03:33,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 07:03:33,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-08 07:03:33,085 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 07:03:33,085 DEBUG [Listener at localhost/41999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 07:03:33,085 DEBUG [Listener at localhost/41999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 07:03:33,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 07:03:33,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 6 msec 2023-02-08 07:03:33,087 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 07:03:33,087 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675840413087 2023-02-08 07:03:33,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-08 07:03:33,100 INFO [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-08 07:03:33,100 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:33,100 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-08 07:03:33,100 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-08 07:03:33,101 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,101 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 07:03:33,104 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:33,104 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:33,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:33,104 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:33,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:33,104 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 07:03:33,104 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:03:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 07:03:33,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-08 07:03:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 07:03:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-08 07:03:33,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-08 07:03:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 07:03:33,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-08 07:03:33,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-08 07:03:33,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-08 07:03:33,105 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-08 07:03:33,105 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:33,106 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-08 07:03:33,106 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-08 07:03:33,106 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 07:03:33,106 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-08 07:03:33,106 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37255,1675839811314' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-08 07:03:33,108 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-08 07:03:33,108 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-08 07:03:33,108 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34803,1675839811287' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-08 07:03:33,110 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,110 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:33,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:33,111 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:33,111 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,111 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:33,112 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:33,112 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-08 07:03:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:33,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37255,1675839811314' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-08 07:03:33,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a8b097c[Count = 0] remaining members to acquire global barrier 2023-02-08 07:03:33,113 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-08 07:03:33,113 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,114 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,114 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,115 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-08 07:03:33,115 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-08 07:03:33,115 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,115 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:03:33,115 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34803,1675839811287' in zk 2023-02-08 07:03:33,115 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-08 07:03:33,115 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-08 07:03:33,115 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 07:03:33,115 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:33,115 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. started... 2023-02-08 07:03:33,115 INFO [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 77cf44c92203d3baac7a181cd62fd8a4 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-08 07:03:33,117 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-08 07:03:33,117 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:33,117 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-08 07:03:33,128 INFO [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/.tmp/f1/306ce523f9f642be832eb0d79ca9e848 2023-02-08 07:03:33,145 INFO [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/.tmp/f2/053c698f7a9945adbe8afc7a5e6dc0bb 2023-02-08 07:03:33,149 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/.tmp/f1/306ce523f9f642be832eb0d79ca9e848 as hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1/306ce523f9f642be832eb0d79ca9e848 2023-02-08 07:03:33,153 INFO [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1/306ce523f9f642be832eb0d79ca9e848, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 07:03:33,154 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/.tmp/f2/053c698f7a9945adbe8afc7a5e6dc0bb as hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2/053c698f7a9945adbe8afc7a5e6dc0bb 2023-02-08 07:03:33,157 INFO [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2/053c698f7a9945adbe8afc7a5e6dc0bb, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 07:03:33,158 INFO [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 77cf44c92203d3baac7a181cd62fd8a4 in 43ms, sequenceid=5, compaction requested=false 2023-02-08 07:03:33,158 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 77cf44c92203d3baac7a181cd62fd8a4: 2023-02-08 07:03:33,158 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-08 07:03:33,158 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 07:03:33,158 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1/306ce523f9f642be832eb0d79ca9e848] hfiles 2023-02-08 07:03:33,158 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1/306ce523f9f642be832eb0d79ca9e848 for snapshot=testWithMapReduceSingleRegion 2023-02-08 07:03:33,159 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2/053c698f7a9945adbe8afc7a5e6dc0bb] hfiles 2023-02-08 07:03:33,159 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2/053c698f7a9945adbe8afc7a5e6dc0bb for snapshot=testWithMapReduceSingleRegion 2023-02-08 07:03:33,174 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. completed. 2023-02-08 07:03:33,174 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-08 07:03:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-08 07:03:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-08 07:03:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37255,1675839811314' in zk 2023-02-08 07:03:33,176 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-08 07:03:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-08 07:03:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-08 07:03:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-08 07:03:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,37255,1675839811314': 2023-02-08 07:03:33,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37255,1675839811314' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-08 07:03:33,179 INFO [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-08 07:03:33,179 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:03:33,179 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:03:33,179 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-08 07:03:33,179 INFO [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 07:03:33,181 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,181 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,181 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,181 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 07:03:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,181 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:33,181 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:33,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,182 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-08 07:03:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:33,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-08 07:03:33,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,183 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,183 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-08 07:03:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,185 DEBUG [Listener at localhost/41999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:33,185 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:33,185 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:33,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 07:03:33,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 07:03:33,187 DEBUG [Listener at localhost/41999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 07:03:33,189 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,189 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:33,190 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 07:03:33,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:33,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 07:03:33,190 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:33,190 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:33,190 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 07:03:33,189 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 07:03:33,190 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-08 07:03:33,190 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-08 07:03:33,190 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 07:03:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 07:03:33,190 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,190 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,190 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,190 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 07:03:33,190 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 07:03:33,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:33,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 07:03:33,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-08 07:03:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 07:03:33,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-08 07:03:33,223 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-08 07:03:33,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-08 07:03:33,223 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-08 07:03:33,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675839813082Consolidate snapshot: testWithMapReduceSingleRegion at 1675839813190 (+108 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1675839813190Writing data manifest for testWithMapReduceSingleRegion at 1675839813193 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1675839813199 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1675839813223 (+24 ms) 2023-02-08 07:03:33,223 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 07:03:33,224 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 139 msec 2023-02-08 07:03:33,387 DEBUG [Listener at localhost/41999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 07:03:33,387 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:33,387 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:33,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 07:03:33,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 07:03:33,388 INFO [Listener at localhost/41999] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 07:03:33,388 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:33,388 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:33,430 INFO [Listener at localhost/41999] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 07:03:33,434 INFO [Listener at localhost/41999] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 07:03:33,461 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:33,538 INFO [Listener at localhost/41999] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 07:03:33,541 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:33,541 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:33,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 07:03:33,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-08 07:03:33,545 INFO [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-08 07:03:33,545 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:33,545 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-08 07:03:33,545 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-08 07:03:33,546 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,546 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:33,547 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:33,547 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:33,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:33,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:33,547 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:33,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:33,548 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:33,548 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 07:03:33,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:03:33,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:33,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 07:03:33,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:33,549 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-08 07:03:33,549 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-08 07:03:33,549 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-08 07:03:33,549 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-08 07:03:33,550 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-08 07:03:33,550 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:33,550 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-08 07:03:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 07:03:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 07:03:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-08 07:03:33,552 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 07:03:33,552 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. started... 2023-02-08 07:03:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-08 07:03:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-08 07:03:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34803,1675839811287' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-08 07:03:33,552 INFO [rs(jenkins-hbase4.apache.org,37255,1675839811314)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 77cf44c92203d3baac7a181cd62fd8a4 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-08 07:03:33,553 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,554 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,554 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:33,568 INFO [rs(jenkins-hbase4.apache.org,37255,1675839811314)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/.tmp/f1/6aae4d99cba44b4aa94f05c3cf58afd0 2023-02-08 07:03:33,589 INFO [rs(jenkins-hbase4.apache.org,37255,1675839811314)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/.tmp/f2/658b9afb1dee46fc8e1d9b289ac1d5d4 2023-02-08 07:03:33,594 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/.tmp/f1/6aae4d99cba44b4aa94f05c3cf58afd0 as hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1/6aae4d99cba44b4aa94f05c3cf58afd0 2023-02-08 07:03:33,597 INFO [rs(jenkins-hbase4.apache.org,37255,1675839811314)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1/6aae4d99cba44b4aa94f05c3cf58afd0, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 07:03:33,599 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/.tmp/f2/658b9afb1dee46fc8e1d9b289ac1d5d4 as hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2/658b9afb1dee46fc8e1d9b289ac1d5d4 2023-02-08 07:03:33,603 INFO [rs(jenkins-hbase4.apache.org,37255,1675839811314)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2/658b9afb1dee46fc8e1d9b289ac1d5d4, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 07:03:33,604 INFO [rs(jenkins-hbase4.apache.org,37255,1675839811314)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 77cf44c92203d3baac7a181cd62fd8a4 in 52ms, sequenceid=9, compaction requested=false 2023-02-08 07:03:33,604 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 77cf44c92203d3baac7a181cd62fd8a4: 2023-02-08 07:03:33,604 DEBUG [rs(jenkins-hbase4.apache.org,37255,1675839811314)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:33,604 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 07:03:33,604 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 07:03:33,604 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,604 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-08 07:03:33,604 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37255,1675839811314' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-08 07:03:33,606 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,606 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:33,606 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,606 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 07:03:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:33,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:33,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37255,1675839811314' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-08 07:03:33,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eb49cf5[Count = 0] remaining members to acquire global barrier 2023-02-08 07:03:33,608 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-08 07:03:33,608 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,610 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,610 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,610 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,610 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-08 07:03:33,611 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 07:03:33,610 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-08 07:03:33,611 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-08 07:03:33,611 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,34803,1675839811287' in zk 2023-02-08 07:03:33,611 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-08 07:03:33,611 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,37255,1675839811314' in zk 2023-02-08 07:03:33,612 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-08 07:03:33,612 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:33,612 DEBUG [member: 'jenkins-hbase4.apache.org,34803,1675839811287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-08 07:03:33,612 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,613 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-08 07:03:33,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:33,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:33,613 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:33,613 DEBUG [member: 'jenkins-hbase4.apache.org,37255,1675839811314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-08 07:03:33,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:33,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,37255,1675839811314': 2023-02-08 07:03:33,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37255,1675839811314' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-08 07:03:33,615 INFO [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-08 07:03:33,616 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 07:03:33,616 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 07:03:33,616 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-08 07:03:33,616 INFO [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 07:03:33,617 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,617 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 07:03:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 07:03:33,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,617 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,617 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:33,617 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:33,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 07:03:33,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:33,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:33,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:33,618 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:33,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:33,619 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 07:03:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 07:03:33,620 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 07:03:33,620 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:33,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:33,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 07:03:33,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:33,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 07:03:33,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-08 07:03:33,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 07:03:33,624 DEBUG [(jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 07:03:33,624 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 07:03:33,625 DEBUG [Listener at localhost/41999] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-08 07:03:33,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:33,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 07:03:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:33,625 DEBUG [Listener at localhost/41999] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 07:03:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 07:03:33,725 DEBUG [Listener at localhost/41999] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 07:03:33,725 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:33,725 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:33,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 07:03:33,812 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/hadoop-6688402657950657038.jar 2023-02-08 07:03:33,816 INFO [Listener at localhost/41999] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675839813071 type: FLUSH version: 2 ttl: 0 2023-02-08 07:03:33,816 DEBUG [Listener at localhost/41999] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41971/user/jenkins/test-data/a8372956-f942-59db-fe79-31e2122dcf99/testWithMapReduceSingleRegion/ead5caa6-ce43-4fac-9964-b6371dd0e5b4/data/default/testWithMapReduce 2023-02-08 07:03:33,817 INFO [Listener at localhost/41999] snapshot.RestoreSnapshotHelper(239): region to add: 77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:33,817 INFO [Listener at localhost/41999] snapshot.RestoreSnapshotHelper(585): clone region=77cf44c92203d3baac7a181cd62fd8a4 as 77cf44c92203d3baac7a181cd62fd8a4 in snapshot testWithMapReduceSingleRegion 2023-02-08 07:03:33,818 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 77cf44c92203d3baac7a181cd62fd8a4, NAME => 'testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41971/user/jenkins/test-data/a8372956-f942-59db-fe79-31e2122dcf99/testWithMapReduceSingleRegion/ead5caa6-ce43-4fac-9964-b6371dd0e5b4 2023-02-08 07:03:33,824 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:33,824 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 306ce523f9f642be832eb0d79ca9e848 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-08 07:03:33,826 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 053c698f7a9945adbe8afc7a5e6dc0bb from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-08 07:03:33,827 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 77cf44c92203d3baac7a181cd62fd8a4, disabling compactions & flushes 2023-02-08 07:03:33,827 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:33,827 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:33,827 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. after waiting 0 ms 2023-02-08 07:03:33,827 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:33,827 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:33,827 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 77cf44c92203d3baac7a181cd62fd8a4: Waiting for close lock at 1675839813827Disabling compacts and flushes for region at 1675839813827Disabling writes for close at 1675839813827Writing region close event to WAL at 1675839813827Closed at 1675839813827 2023-02-08 07:03:33,828 INFO [Listener at localhost/41999] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675839813071 type: FLUSH version: 2 ttl: 0 2023-02-08 07:03:33,828 DEBUG [Listener at localhost/41999] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41971/user/jenkins/test-data/a8372956-f942-59db-fe79-31e2122dcf99/testWithMapReduceSingleRegion/ead5caa6-ce43-4fac-9964-b6371dd0e5b4 2023-02-08 07:03:33,828 DEBUG [Listener at localhost/41999] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41971/user/jenkins/test-data/a8372956-f942-59db-fe79-31e2122dcf99/testWithMapReduceSingleRegion/ead5caa6-ce43-4fac-9964-b6371dd0e5b4 2023-02-08 07:03:33,828 DEBUG [Listener at localhost/41999] util.CommonFSUtils(699): |-data/ 2023-02-08 07:03:33,829 DEBUG [Listener at localhost/41999] util.CommonFSUtils(699): |----default/ 2023-02-08 07:03:33,829 DEBUG [Listener at localhost/41999] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-08 07:03:33,829 DEBUG [Listener at localhost/41999] util.CommonFSUtils(699): |----------77cf44c92203d3baac7a181cd62fd8a4/ 2023-02-08 07:03:33,829 DEBUG [Listener at localhost/41999] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 07:03:33,829 DEBUG [Listener at localhost/41999] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 07:03:33,830 DEBUG [Listener at localhost/41999] util.CommonFSUtils(702): |----------------testWithMapReduce=77cf44c92203d3baac7a181cd62fd8a4-306ce523f9f642be832eb0d79ca9e848 2023-02-08 07:03:33,830 DEBUG [Listener at localhost/41999] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 07:03:33,830 DEBUG [Listener at localhost/41999] util.CommonFSUtils(702): |----------------testWithMapReduce=77cf44c92203d3baac7a181cd62fd8a4-053c698f7a9945adbe8afc7a5e6dc0bb 2023-02-08 07:03:33,830 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,831 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,831 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,831 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,832 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,832 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,832 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,899 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/hadoop-3500924536286437254.jar 2023-02-08 07:03:33,899 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,900 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,900 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,900 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,901 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,901 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,901 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-08 07:03:33,902 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-08 07:03:33,902 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-08 07:03:33,903 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-08 07:03:33,903 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-08 07:03:33,904 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-08 07:03:33,904 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-08 07:03:33,904 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-08 07:03:33,905 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-08 07:03:33,905 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-08 07:03:33,905 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-08 07:03:33,906 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 07:03:33,906 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 07:03:33,906 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 07:03:33,907 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-08 07:03:33,974 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/hadoop-9019289354139551812.jar 2023-02-08 07:03:33,974 DEBUG [Listener at localhost/41999] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-08 07:03:33,979 WARN [Listener at localhost/41999] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-08 07:03:34,010 INFO [Listener at localhost/41999] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-08 07:03:34,091 WARN [Listener at localhost/41999] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/mapreduce.cluster.local.dir/1675839814057/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-08 07:03:34,091 WARN [Listener at localhost/41999] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/mapreduce.cluster.local.dir/1675839814057/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-08 07:03:34,124 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 07:03:34,124 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 07:03:34,125 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 07:03:34,126 INFO [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:34,127 DEBUG [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/a8372956-f942-59db-fe79-31e2122dcf99/testWithMapReduceSingleRegion/ead5caa6-ce43-4fac-9964-b6371dd0e5b4/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1 2023-02-08 07:03:34,127 INFO [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77cf44c92203d3baac7a181cd62fd8a4 columnFamilyName f1 2023-02-08 07:03:34,131 DEBUG [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] regionserver.HStore(539): loaded hdfs://localhost:41971/user/jenkins/test-data/a8372956-f942-59db-fe79-31e2122dcf99/testWithMapReduceSingleRegion/ead5caa6-ce43-4fac-9964-b6371dd0e5b4/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1/testWithMapReduce=77cf44c92203d3baac7a181cd62fd8a4-306ce523f9f642be832eb0d79ca9e848 2023-02-08 07:03:34,131 INFO [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] regionserver.HStore(310): Store=77cf44c92203d3baac7a181cd62fd8a4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:34,131 INFO [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:34,132 DEBUG [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41971/user/jenkins/test-data/a8372956-f942-59db-fe79-31e2122dcf99/testWithMapReduceSingleRegion/ead5caa6-ce43-4fac-9964-b6371dd0e5b4/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2 2023-02-08 07:03:34,132 INFO [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77cf44c92203d3baac7a181cd62fd8a4 columnFamilyName f2 2023-02-08 07:03:34,136 DEBUG [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] regionserver.HStore(539): loaded hdfs://localhost:41971/user/jenkins/test-data/a8372956-f942-59db-fe79-31e2122dcf99/testWithMapReduceSingleRegion/ead5caa6-ce43-4fac-9964-b6371dd0e5b4/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2/testWithMapReduce=77cf44c92203d3baac7a181cd62fd8a4-053c698f7a9945adbe8afc7a5e6dc0bb 2023-02-08 07:03:34,136 INFO [StoreOpener-77cf44c92203d3baac7a181cd62fd8a4-1] regionserver.HStore(310): Store=77cf44c92203d3baac7a181cd62fd8a4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 07:03:34,136 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 07:03:34,136 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 77cf44c92203d3baac7a181cd62fd8a4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61440517, jitterRate=-0.08446495234966278}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 07:03:34,136 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 77cf44c92203d3baac7a181cd62fd8a4: Writing region info on filesystem at 1675839814125Initializing all the Stores at 1675839814125Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839814126 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675839814126Region opened successfully at 1675839814136 (+10 ms) 2023-02-08 07:03:34,226 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 77cf44c92203d3baac7a181cd62fd8a4, disabling compactions & flushes 2023-02-08 07:03:34,226 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:34,226 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:34,226 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. after waiting 0 ms 2023-02-08 07:03:34,226 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:34,228 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:34,228 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 77cf44c92203d3baac7a181cd62fd8a4: Waiting for close lock at 1675839814226Disabling compacts and flushes for region at 1675839814226Disabling writes for close at 1675839814226Writing region close event to WAL at 1675839814228 (+2 ms)Closed at 1675839814228 2023-02-08 07:03:35,126 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:35,127 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:35,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-08 07:03:35,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-08 07:03:35,130 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:35,130 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:35,131 INFO [Listener at localhost/41999] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-08 07:03:35,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-08 07:03:35,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-08 07:03:35,133 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:35,133 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:35,134 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839815134"}]},"ts":"1675839815134"} 2023-02-08 07:03:35,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 07:03:35,135 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-08 07:03:35,137 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-08 07:03:35,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=77cf44c92203d3baac7a181cd62fd8a4, UNASSIGN}] 2023-02-08 07:03:35,138 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=77cf44c92203d3baac7a181cd62fd8a4, UNASSIGN 2023-02-08 07:03:35,138 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=77cf44c92203d3baac7a181cd62fd8a4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:35,138 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675839815138"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675839815138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675839815138"}]},"ts":"1675839815138"} 2023-02-08 07:03:35,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 77cf44c92203d3baac7a181cd62fd8a4, server=jenkins-hbase4.apache.org,37255,1675839811314}] 2023-02-08 07:03:35,234 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:35,234 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:35,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 07:03:35,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:35,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 77cf44c92203d3baac7a181cd62fd8a4, disabling compactions & flushes 2023-02-08 07:03:35,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:35,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:35,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. after waiting 0 ms 2023-02-08 07:03:35,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:35,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 07:03:35,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4. 2023-02-08 07:03:35,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 77cf44c92203d3baac7a181cd62fd8a4: Waiting for close lock at 1675839815291Running coprocessor pre-close hooks at 1675839815291Disabling compacts and flushes for region at 1675839815291Disabling writes for close at 1675839815291Writing region close event to WAL at 1675839815292 (+1 ms)Running coprocessor post-close hooks at 1675839815295 (+3 ms)Closed at 1675839815295 2023-02-08 07:03:35,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:35,296 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=77cf44c92203d3baac7a181cd62fd8a4, regionState=CLOSED 2023-02-08 07:03:35,296 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675839815296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675839815296"}]},"ts":"1675839815296"} 2023-02-08 07:03:35,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-08 07:03:35,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 77cf44c92203d3baac7a181cd62fd8a4, server=jenkins-hbase4.apache.org,37255,1675839811314 in 158 msec 2023-02-08 07:03:35,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-08 07:03:35,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=77cf44c92203d3baac7a181cd62fd8a4, UNASSIGN in 161 msec 2023-02-08 07:03:35,300 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675839815300"}]},"ts":"1675839815300"} 2023-02-08 07:03:35,301 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-08 07:03:35,302 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-08 07:03:35,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 172 msec 2023-02-08 07:03:35,436 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:35,436 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:35,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 07:03:35,437 INFO [Listener at localhost/41999] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-08 07:03:35,437 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:35,437 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:35,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-08 07:03:35,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-08 07:03:35,440 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 07:03:35,440 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:35,440 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:35,440 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 07:03:35,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 07:03:35,443 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:35,445 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1, FileablePath, hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2, FileablePath, hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/recovered.edits] 2023-02-08 07:03:35,448 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1/306ce523f9f642be832eb0d79ca9e848 to hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/archive/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1/306ce523f9f642be832eb0d79ca9e848 2023-02-08 07:03:35,449 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1/6aae4d99cba44b4aa94f05c3cf58afd0 to hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/archive/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f1/6aae4d99cba44b4aa94f05c3cf58afd0 2023-02-08 07:03:35,451 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2/053c698f7a9945adbe8afc7a5e6dc0bb to hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/archive/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2/053c698f7a9945adbe8afc7a5e6dc0bb 2023-02-08 07:03:35,452 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2/658b9afb1dee46fc8e1d9b289ac1d5d4 to hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/archive/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/f2/658b9afb1dee46fc8e1d9b289ac1d5d4 2023-02-08 07:03:35,454 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/recovered.edits/12.seqid to hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/archive/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4/recovered.edits/12.seqid 2023-02-08 07:03:35,454 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/.tmp/data/default/testWithMapReduce/77cf44c92203d3baac7a181cd62fd8a4 2023-02-08 07:03:35,454 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-08 07:03:35,456 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 07:03:35,457 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-08 07:03:35,458 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-08 07:03:35,459 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 07:03:35,459 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-08 07:03:35,459 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675839815459"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:35,461 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-08 07:03:35,461 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 77cf44c92203d3baac7a181cd62fd8a4, NAME => 'testWithMapReduce,,1675839812348.77cf44c92203d3baac7a181cd62fd8a4.', STARTKEY => '', ENDKEY => ''}] 2023-02-08 07:03:35,461 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-08 07:03:35,461 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675839815461"}]},"ts":"9223372036854775807"} 2023-02-08 07:03:35,462 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-08 07:03:35,463 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 07:03:35,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 25 msec 2023-02-08 07:03:35,541 INFO [Listener at localhost/41999] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 07:03:35,542 INFO [Listener at localhost/41999] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 07:03:35,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 07:03:35,543 INFO [Listener at localhost/41999] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-08 07:03:35,543 INFO [Listener at localhost/41999] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 07:03:35,543 INFO [Listener at localhost/41999] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 07:03:35,543 DEBUG [Listener at localhost/41999] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f24deed to 127.0.0.1:51554 2023-02-08 07:03:35,543 DEBUG [Listener at localhost/41999] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:35,543 DEBUG [Listener at localhost/41999] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 07:03:35,543 DEBUG [Listener at localhost/41999] util.JVMClusterUtil(257): Found active master hash=2083432848, stopped=false 2023-02-08 07:03:35,543 INFO [Listener at localhost/41999] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39145,1675839811235 2023-02-08 07:03:35,546 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:35,546 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:35,546 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:35,546 INFO [Listener at localhost/41999] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 07:03:35,546 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 07:03:35,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:35,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:35,548 DEBUG [Listener at localhost/41999] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47d77e21 to 127.0.0.1:51554 2023-02-08 07:03:35,548 DEBUG [Listener at localhost/41999] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:35,548 INFO [Listener at localhost/41999] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34803,1675839811287' ***** 2023-02-08 07:03:35,548 INFO [Listener at localhost/41999] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:03:35,548 INFO [Listener at localhost/41999] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37255,1675839811314' ***** 2023-02-08 07:03:35,548 INFO [Listener at localhost/41999] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 07:03:35,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 07:03:35,548 INFO [RS:1;jenkins-hbase4:37255] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:03:35,548 INFO [RS:0;jenkins-hbase4:34803] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 07:03:35,548 INFO [RS:1;jenkins-hbase4:37255] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:03:35,549 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:03:35,549 INFO [RS:1;jenkins-hbase4:37255] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:03:35,549 INFO [RS:0;jenkins-hbase4:34803] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 07:03:35,548 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 07:03:35,550 INFO [RS:0;jenkins-hbase4:34803] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 07:03:35,549 INFO [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:35,550 INFO [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(3304): Received CLOSE for 1d8776d122eee6c4feeeb6d7126ddd63 2023-02-08 07:03:35,550 DEBUG [RS:1;jenkins-hbase4:37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x565b818c to 127.0.0.1:51554 2023-02-08 07:03:35,550 DEBUG [RS:1;jenkins-hbase4:37255] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:35,550 INFO [RS:1;jenkins-hbase4:37255] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:03:35,550 INFO [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:35,551 INFO [RS:1;jenkins-hbase4:37255] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:03:35,551 INFO [RS:1;jenkins-hbase4:37255] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:03:35,551 DEBUG [RS:0;jenkins-hbase4:34803] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x561cc219 to 127.0.0.1:51554 2023-02-08 07:03:35,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1d8776d122eee6c4feeeb6d7126ddd63, disabling compactions & flushes 2023-02-08 07:03:35,551 DEBUG [RS:0;jenkins-hbase4:34803] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:35,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. 2023-02-08 07:03:35,551 INFO [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 07:03:35,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. 2023-02-08 07:03:35,551 INFO [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 07:03:35,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. after waiting 0 ms 2023-02-08 07:03:35,551 DEBUG [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(1479): Online Regions={1d8776d122eee6c4feeeb6d7126ddd63=hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63.} 2023-02-08 07:03:35,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. 2023-02-08 07:03:35,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1d8776d122eee6c4feeeb6d7126ddd63 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 07:03:35,551 INFO [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 07:03:35,551 DEBUG [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(1505): Waiting on 1d8776d122eee6c4feeeb6d7126ddd63 2023-02-08 07:03:35,551 DEBUG [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-08 07:03:35,551 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 07:03:35,551 DEBUG [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 07:03:35,551 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 07:03:35,551 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 07:03:35,551 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 07:03:35,551 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 07:03:35,551 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-08 07:03:35,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63/.tmp/info/7db60296aa864bdc8157f89944387e1f 2023-02-08 07:03:35,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63/.tmp/info/7db60296aa864bdc8157f89944387e1f as hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63/info/7db60296aa864bdc8157f89944387e1f 2023-02-08 07:03:35,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63/info/7db60296aa864bdc8157f89944387e1f, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 07:03:35,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1d8776d122eee6c4feeeb6d7126ddd63 in 18ms, sequenceid=6, compaction requested=false 2023-02-08 07:03:35,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/namespace/1d8776d122eee6c4feeeb6d7126ddd63/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 07:03:35,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. 2023-02-08 07:03:35,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1d8776d122eee6c4feeeb6d7126ddd63: Waiting for close lock at 1675839815551Running coprocessor pre-close hooks at 1675839815551Disabling compacts and flushes for region at 1675839815551Disabling writes for close at 1675839815551Obtaining lock to block concurrent updates at 1675839815551Preparing flush snapshotting stores in 1d8776d122eee6c4feeeb6d7126ddd63 at 1675839815551Finished memstore snapshotting hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675839815551Flushing stores of hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. at 1675839815552 (+1 ms)Flushing 1d8776d122eee6c4feeeb6d7126ddd63/info: creating writer at 1675839815552Flushing 1d8776d122eee6c4feeeb6d7126ddd63/info: appending metadata at 1675839815554 (+2 ms)Flushing 1d8776d122eee6c4feeeb6d7126ddd63/info: closing flushed file at 1675839815554Flushing 1d8776d122eee6c4feeeb6d7126ddd63/info: reopening flushed file at 1675839815565 (+11 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1d8776d122eee6c4feeeb6d7126ddd63 in 18ms, sequenceid=6, compaction requested=false at 1675839815569 (+4 ms)Writing region close event to WAL at 1675839815569Running coprocessor post-close hooks at 1675839815572 (+3 ms)Closed at 1675839815572 2023-02-08 07:03:35,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675839811853.1d8776d122eee6c4feeeb6d7126ddd63. 2023-02-08 07:03:35,587 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:35,608 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-08 07:03:35,608 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-08 07:03:35,617 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-08 07:03:35,618 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-08 07:03:35,626 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:35,751 INFO [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34803,1675839811287; all regions closed. 2023-02-08 07:03:35,751 DEBUG [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 07:03:35,755 DEBUG [RS:0;jenkins-hbase4:34803] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/oldWALs 2023-02-08 07:03:35,755 INFO [RS:0;jenkins-hbase4:34803] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34803%2C1675839811287:(num 1675839812201) 2023-02-08 07:03:35,755 DEBUG [RS:0;jenkins-hbase4:34803] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:35,755 INFO [RS:0;jenkins-hbase4:34803] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:35,755 INFO [RS:0;jenkins-hbase4:34803] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 07:03:35,755 INFO [RS:0;jenkins-hbase4:34803] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 07:03:35,755 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:35,755 INFO [RS:0;jenkins-hbase4:34803] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 07:03:35,755 INFO [RS:0;jenkins-hbase4:34803] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 07:03:35,756 INFO [RS:0;jenkins-hbase4:34803] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34803 2023-02-08 07:03:35,758 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:35,758 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:35,758 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:35,758 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34803,1675839811287 2023-02-08 07:03:35,758 ERROR [Listener at localhost/41999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73e61c8 rejected from java.util.concurrent.ThreadPoolExecutor@301e5f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:35,758 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:35,759 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34803,1675839811287] 2023-02-08 07:03:35,759 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34803,1675839811287; numProcessing=1 2023-02-08 07:03:35,760 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34803,1675839811287 already deleted, retry=false 2023-02-08 07:03:35,760 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34803,1675839811287 expired; onlineServers=1 2023-02-08 07:03:35,952 DEBUG [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 07:03:35,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/.tmp/info/94c1ed096bea4901b11cbb5b7d3f7ce7 2023-02-08 07:03:35,965 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 94c1ed096bea4901b11cbb5b7d3f7ce7 2023-02-08 07:03:35,971 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/.tmp/rep_barrier/00d4d7ea3424463899567bc866003420 2023-02-08 07:03:35,974 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00d4d7ea3424463899567bc866003420 2023-02-08 07:03:35,986 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/.tmp/table/c1f5d7e1454d46559b5038a488139523 2023-02-08 07:03:35,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c1f5d7e1454d46559b5038a488139523 2023-02-08 07:03:35,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/.tmp/info/94c1ed096bea4901b11cbb5b7d3f7ce7 as hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/info/94c1ed096bea4901b11cbb5b7d3f7ce7 2023-02-08 07:03:35,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 94c1ed096bea4901b11cbb5b7d3f7ce7 2023-02-08 07:03:35,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/info/94c1ed096bea4901b11cbb5b7d3f7ce7, entries=12, sequenceid=21, filesize=6.2 K 2023-02-08 07:03:35,995 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/.tmp/rep_barrier/00d4d7ea3424463899567bc866003420 as hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/rep_barrier/00d4d7ea3424463899567bc866003420 2023-02-08 07:03:35,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00d4d7ea3424463899567bc866003420 2023-02-08 07:03:35,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/rep_barrier/00d4d7ea3424463899567bc866003420, entries=1, sequenceid=21, filesize=5.0 K 2023-02-08 07:03:35,999 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/.tmp/table/c1f5d7e1454d46559b5038a488139523 as hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/table/c1f5d7e1454d46559b5038a488139523 2023-02-08 07:03:36,002 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c1f5d7e1454d46559b5038a488139523 2023-02-08 07:03:36,002 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/table/c1f5d7e1454d46559b5038a488139523, entries=4, sequenceid=21, filesize=5.0 K 2023-02-08 07:03:36,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 452ms, sequenceid=21, compaction requested=false 2023-02-08 07:03:36,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-08 07:03:36,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 07:03:36,006 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:36,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675839815551Running coprocessor pre-close hooks at 1675839815551Disabling compacts and flushes for region at 1675839815551Disabling writes for close at 1675839815551Obtaining lock to block concurrent updates at 1675839815551Preparing flush snapshotting stores in 1588230740 at 1675839815551Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1675839815552 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675839815552Flushing 1588230740/info: creating writer at 1675839815552Flushing 1588230740/info: appending metadata at 1675839815554 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675839815554Flushing 1588230740/rep_barrier: creating writer at 1675839815965 (+411 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675839815966 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675839815966Flushing 1588230740/table: creating writer at 1675839815974 (+8 ms)Flushing 1588230740/table: appending metadata at 1675839815976 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675839815976Flushing 1588230740/info: reopening flushed file at 1675839815991 (+15 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675839815995 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675839815999 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 452ms, sequenceid=21, compaction requested=false at 1675839816003 (+4 ms)Writing region close event to WAL at 1675839816004 (+1 ms)Running coprocessor post-close hooks at 1675839816006 (+2 ms)Closed at 1675839816006 2023-02-08 07:03:36,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 07:03:36,046 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:36,046 INFO [RS:0;jenkins-hbase4:34803] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34803,1675839811287; zookeeper connection closed. 2023-02-08 07:03:36,047 ERROR [Listener at localhost/41999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3cb5802 rejected from java.util.concurrent.ThreadPoolExecutor@301e5f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:36,047 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10032be18560001, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:36,047 ERROR [Listener at localhost/41999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b2d24d9 rejected from java.util.concurrent.ThreadPoolExecutor@301e5f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:36,047 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@43d8e9f1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@43d8e9f1 2023-02-08 07:03:36,152 INFO [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37255,1675839811314; all regions closed. 2023-02-08 07:03:36,155 DEBUG [RS:1;jenkins-hbase4:37255] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/oldWALs 2023-02-08 07:03:36,155 INFO [RS:1;jenkins-hbase4:37255] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37255%2C1675839811314.meta:.meta(num 1675839811806) 2023-02-08 07:03:36,158 DEBUG [RS:1;jenkins-hbase4:37255] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/oldWALs 2023-02-08 07:03:36,158 INFO [RS:1;jenkins-hbase4:37255] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37255%2C1675839811314:(num 1675839812611) 2023-02-08 07:03:36,158 DEBUG [RS:1;jenkins-hbase4:37255] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:36,159 INFO [RS:1;jenkins-hbase4:37255] regionserver.LeaseManager(133): Closed leases 2023-02-08 07:03:36,159 INFO [RS:1;jenkins-hbase4:37255] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 07:03:36,159 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:36,162 INFO [RS:1;jenkins-hbase4:37255] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37255 2023-02-08 07:03:36,165 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 07:03:36,165 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37255,1675839811314 2023-02-08 07:03:36,165 ERROR [Listener at localhost/41999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b1139bf rejected from java.util.concurrent.ThreadPoolExecutor@6f2ea005[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:36,166 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37255,1675839811314] 2023-02-08 07:03:36,166 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37255,1675839811314; numProcessing=2 2023-02-08 07:03:36,167 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37255,1675839811314 already deleted, retry=false 2023-02-08 07:03:36,167 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37255,1675839811314 expired; onlineServers=0 2023-02-08 07:03:36,167 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39145,1675839811235' ***** 2023-02-08 07:03:36,167 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 07:03:36,168 DEBUG [M:0;jenkins-hbase4:39145] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@781122cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 07:03:36,168 INFO [M:0;jenkins-hbase4:39145] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39145,1675839811235 2023-02-08 07:03:36,168 INFO [M:0;jenkins-hbase4:39145] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39145,1675839811235; all regions closed. 2023-02-08 07:03:36,168 DEBUG [M:0;jenkins-hbase4:39145] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 07:03:36,168 DEBUG [M:0;jenkins-hbase4:39145] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 07:03:36,168 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 07:03:36,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839811454] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675839811454,5,FailOnTimeoutGroup] 2023-02-08 07:03:36,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839811454] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675839811454,5,FailOnTimeoutGroup] 2023-02-08 07:03:36,168 DEBUG [M:0;jenkins-hbase4:39145] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 07:03:36,170 INFO [M:0;jenkins-hbase4:39145] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 07:03:36,170 INFO [M:0;jenkins-hbase4:39145] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 07:03:36,170 INFO [M:0;jenkins-hbase4:39145] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 07:03:36,170 DEBUG [M:0;jenkins-hbase4:39145] master.HMaster(1502): Stopping service threads 2023-02-08 07:03:36,170 INFO [M:0;jenkins-hbase4:39145] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 07:03:36,170 ERROR [M:0;jenkins-hbase4:39145] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-08 07:03:36,170 INFO [M:0;jenkins-hbase4:39145] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 07:03:36,170 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 07:03:36,170 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 07:03:36,171 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 07:03:36,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 07:03:36,171 DEBUG [M:0;jenkins-hbase4:39145] zookeeper.ZKUtil(398): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 07:03:36,171 WARN [M:0;jenkins-hbase4:39145] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 07:03:36,171 INFO [M:0;jenkins-hbase4:39145] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 07:03:36,172 INFO [M:0;jenkins-hbase4:39145] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 07:03:36,172 DEBUG [M:0;jenkins-hbase4:39145] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 07:03:36,172 INFO [M:0;jenkins-hbase4:39145] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:36,172 DEBUG [M:0;jenkins-hbase4:39145] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:36,172 DEBUG [M:0;jenkins-hbase4:39145] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 07:03:36,172 DEBUG [M:0;jenkins-hbase4:39145] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:36,172 INFO [M:0;jenkins-hbase4:39145] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.69 KB heapSize=65.67 KB 2023-02-08 07:03:36,179 INFO [M:0;jenkins-hbase4:39145] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.69 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6fb2c394715149d2a5b27b515f8fcb99 2023-02-08 07:03:36,183 DEBUG [M:0;jenkins-hbase4:39145] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6fb2c394715149d2a5b27b515f8fcb99 as hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6fb2c394715149d2a5b27b515f8fcb99 2023-02-08 07:03:36,187 INFO [M:0;jenkins-hbase4:39145] regionserver.HStore(1080): Added hdfs://localhost:41971/user/jenkins/test-data/bcfb59d7-76f7-5636-5824-49d282415543/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6fb2c394715149d2a5b27b515f8fcb99, entries=17, sequenceid=132, filesize=8.6 K 2023-02-08 07:03:36,187 INFO [M:0;jenkins-hbase4:39145] regionserver.HRegion(2947): Finished flush of dataSize ~54.69 KB/56006, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false 2023-02-08 07:03:36,188 INFO [M:0;jenkins-hbase4:39145] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 07:03:36,188 DEBUG [M:0;jenkins-hbase4:39145] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675839816172Disabling compacts and flushes for region at 1675839816172Disabling writes for close at 1675839816172Obtaining lock to block concurrent updates at 1675839816172Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675839816172Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=56006, getHeapSize=67232, getOffHeapSize=0, getCellsCount=145 at 1675839816172Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675839816173 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675839816173Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675839816175 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675839816175Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675839816184 (+9 ms)Finished flush of dataSize ~54.69 KB/56006, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false at 1675839816187 (+3 ms)Writing region close event to WAL at 1675839816188 (+1 ms)Closed at 1675839816188 2023-02-08 07:03:36,190 INFO [M:0;jenkins-hbase4:39145] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 07:03:36,190 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 07:03:36,190 INFO [M:0;jenkins-hbase4:39145] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39145 2023-02-08 07:03:36,192 DEBUG [M:0;jenkins-hbase4:39145] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39145,1675839811235 already deleted, retry=false 2023-02-08 07:03:36,267 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:36,267 INFO [RS:1;jenkins-hbase4:37255] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37255,1675839811314; zookeeper connection closed. 2023-02-08 07:03:36,267 ERROR [Listener at localhost/41999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7972c8d7 rejected from java.util.concurrent.ThreadPoolExecutor@6f2ea005[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:36,267 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): regionserver:37255-0x10032be18560002, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:36,267 ERROR [Listener at localhost/41999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1787f73 rejected from java.util.concurrent.ThreadPoolExecutor@6f2ea005[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:36,267 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@fd6d311] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@fd6d311 2023-02-08 07:03:36,267 INFO [Listener at localhost/41999] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 07:03:36,367 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:36,367 INFO [M:0;jenkins-hbase4:39145] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39145,1675839811235; zookeeper connection closed. 2023-02-08 07:03:36,367 ERROR [Listener at localhost/41999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6765f866 rejected from java.util.concurrent.ThreadPoolExecutor@635a7052[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:36,368 DEBUG [Listener at localhost/41999-EventThread] zookeeper.ZKWatcher(600): master:39145-0x10032be18560000, quorum=127.0.0.1:51554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 07:03:36,368 ERROR [Listener at localhost/41999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5fda86bf rejected from java.util.concurrent.ThreadPoolExecutor@635a7052[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 07:03:36,368 WARN [Listener at localhost/41999] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:03:36,372 INFO [Listener at localhost/41999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:36,473 WARN [BP-399176925-172.31.14.131-1675839810686 heartbeating to localhost/127.0.0.1:41971] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:03:36,473 WARN [BP-399176925-172.31.14.131-1675839810686 heartbeating to localhost/127.0.0.1:41971] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-399176925-172.31.14.131-1675839810686 (Datanode Uuid 8b43fab7-9cab-4ebe-af98-93517171b4d9) service to localhost/127.0.0.1:41971 2023-02-08 07:03:36,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/cluster_2790d87b-6f3d-7aed-00f3-ed98e59c4999/dfs/data/data3/current/BP-399176925-172.31.14.131-1675839810686] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:36,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/cluster_2790d87b-6f3d-7aed-00f3-ed98e59c4999/dfs/data/data4/current/BP-399176925-172.31.14.131-1675839810686] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:36,475 WARN [Listener at localhost/41999] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 07:03:36,478 INFO [Listener at localhost/41999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:36,579 WARN [BP-399176925-172.31.14.131-1675839810686 heartbeating to localhost/127.0.0.1:41971] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 07:03:36,579 WARN [BP-399176925-172.31.14.131-1675839810686 heartbeating to localhost/127.0.0.1:41971] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-399176925-172.31.14.131-1675839810686 (Datanode Uuid d4d06675-c957-4cef-9017-ea9dbd274d18) service to localhost/127.0.0.1:41971 2023-02-08 07:03:36,580 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/cluster_2790d87b-6f3d-7aed-00f3-ed98e59c4999/dfs/data/data1/current/BP-399176925-172.31.14.131-1675839810686] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:36,580 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23a935c6-08f8-99f5-4ccc-abc8f9fcf8bf/cluster_2790d87b-6f3d-7aed-00f3-ed98e59c4999/dfs/data/data2/current/BP-399176925-172.31.14.131-1675839810686] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 07:03:36,591 INFO [Listener at localhost/41999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 07:03:36,709 INFO [Listener at localhost/41999] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 07:03:36,730 INFO [Listener at localhost/41999] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 07:03:36,742 INFO [Listener at localhost/41999] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=296 (was 275) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:41971 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41999 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39145,1675839811235)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:41971 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:41971 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41971 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:41971 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:41971 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (114716313) connection to localhost/127.0.0.1:41971 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=603 (was 587) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 254), ProcessCount=165 (was 165), AvailableMemoryMB=4064 (was 4124)